How to fix it.
spark-submit --master local[*] spark.jar ...
2. We need to also use…
When I was a student, I thought the ability to drink a lot of alcohol is cool. And with some students who cannot drink, I kind of don’t spend much of my time with. Most of my closed friends are someone who can drink.
As later in life, I found it completely wrong. Drinking only help us to get rid of problems for sometime. And we thought it might bring us the happiness but in fact it is not. Happiness is completely different thing and in fact we can learn to be happy without having external things.
Drinking alcohol causes…
We are humans. And I believe the nature of human is always seeking for something new. I understand that we do need routines. But if we all stay in the same routine day after day, even that’s a good routine. We eventually feel bored.
Recently, I felt this too. I believe this is the time to stay slow, comeback to something I forgot, or I might say we forgot. When my wife and I were in the early relationships, I regularly bought her flowers. I just realized that recently I did not do that. Maybe because of I’m busy with…
The reason for run service failed due to zookeeper and kafka cannot find java. The temporary workaround this is to add environment variable to zookeeper.service and kafka.service files.
kafka.service
[Unit]
Requires=zookeeper.service
After=zookeeper.service[Service]
Type=simple
User=kafka
ExecStart=/bin/sh -c '/home/kafka/kafka/bin/kafka-server-start.sh /home/kafka/kafka/config/server.properties > /home/kafka/kafka/kafka.log 2>&1'
ExecStop=/home/kafka/kafka/bin/kafka-server-stop.sh
Restart=on-abnormalEnvironment=JAVA_HOME=/usr/lib/jvm/jdk1.8.0_281[Install]
WantedBy=multi-user.target
zookeeper.service
[Unit]
Requires=network.target remote-fs.target
After=network.target remote-fs.target[Service]
Type=simple
User=kafka
ExecStart=/home/kafka/kafka/bin/zookeeper-server-start.sh /home/kafka/kafka/config/zookeeper.properties
ExecStop=/home/kafka/kafka/bin/zookeeper-server-stop.sh
Restart=on-abnormalEnvironment=JAVA_HOME=/usr/lib/jvm/jdk1.8.0_281[Install]
WantedBy=multi-user.target
Reload daemon
sudo systemctl daemon-reload…
local all all trust
host all all 127.0.0.1/32 trust
host all all ::1/128 trust
host all all 0.0.0.0/0 trust
local replication all trust
host replication all 127.0.0.1/32 trust
host replication all ::1/128 trust
2. postgresql.conf
listen_addresses = '*'
3.docker-compose.yml
postgres:
image: postgis/postgis:11-2.5
networks:
- bagdb
volumes:
- postgres:/var/lib/postgresql/data
ports:
- "5433:5432"
4. Run docker-compose up
docker-compose -f docker-compose-env.yml up -d
5. Copy file using docker
docker cp pg_hba.conf {container_name}:{location_pg_hba}
6. Kill exisitng postgres
docker-compose -f docker-compose-env.yml kill postgres
7. …
A passionate automation engineer who strongly believes in “A man can do anything he wants if he puts in the work”.