Open
Description
1、i created a hadoop and hive sever in my remote server with command 'docker-compose up -d'
2、then i run my pyspark script in mac jupter. my mac detail as follows
1.1、mac spark version 3.2.1
1.2、mac python version 3.9
1.3、my script
1.4、mac spark conf
<property><name>hive.metastore.uris</name><value>thrift://10.xx.xx.xx:9083</value></property>
<property><name>datanucleus.autoCreateSchema</name><value>false</value></property>
<property><name>javax.jdo.option.ConnectionURL</name><value>jdbc:postgresql://hive-metastore-postgresql/metastore</value></property>
<property><name>javax.jdo.option.ConnectionDriverName</name><value>org.postgresql.Driver</value></property>
<property><name>javax.jdo.option.ConnectionPassword</name><value>hive</value></property>
<property><name>javax.jdo.option.ConnectionUserName</name><value>hive</value></property>
3、but i can read/write hive table use dbwear with hive server remoteip:10000
4、i can ping namenode in hive-metaserver
thank you
Metadata
Metadata
Assignees
Labels
No labels