Skip to content

Latest commit

 

History

History
 
 

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

README.md

A Secure CockroachDB Cluster with Kerberos, Sqlalchemy and HAProxy acting as load balancer


Check out my series of articles on CockroachDB and Kerberos below:


Services

  • roach-0 - CockroachDB node
  • roach-1 - CockroachDB node
  • roach-2 - CockroachDB node
  • lb - HAProxy acting as load balancer
  • roach-cert - Holds certificates as volume mounts
  • kdc - MIT Kerberos realm
  • web - sqlaclhemy server

Getting started

If you are using Google Chrome as your browser, you may want to navigate here chrome://flags/#allow-insecure-localhost and set this flag to Enabled.


The SQLAlchemy application with CockroachDB is based on the CockroachDB SQLAlchemy tutorial. Feel free to read the article [8](#Part 8) above.

  1. Start the application
./up.sh
Creating network "cockroach-gssapi-sqlalchemy_default" with the default driver Creating network "cockroach-gssapi-sqlalchemy_roachnet" with the default driver Creating volume "cockroach-gssapi-sqlalchemy_certs-roach-0" with default driver Creating volume "cockroach-gssapi-sqlalchemy_certs-roach-1" with default driver Creating volume "cockroach-gssapi-sqlalchemy_certs-roach-2" with default driver Creating volume "cockroach-gssapi-sqlalchemy_keytab" with default driver Creating volume "cockroach-gssapi-sqlalchemy_certs-client" with default driver Creating roach-cert ... done Creating kdc ... done Creating roach-0 ... done Creating roach-1 ... done Creating roach-2 ... done Creating lb ... done Creating web ... done CREATE ROLE Time: 8.6299ms CREATE DATABASE Time: 15.1892ms GRANT Time: 6.4917ms SET CLUSTER SETTING Time: 12.3533ms SET CLUSTER SETTING Time: 11.2168ms SET CLUSTER SETTING Time: 15.9956ms SET CLUSTER SETTING Time: 12.6019ms
  1. Check the logs
docker logs web
2020-08-17 14:29:32,949 INFO sqlalchemy.engine.base.Engine BEGIN (implicit) 2020-08-17 14:29:32,949 INFO sqlalchemy.engine.base.Engine SAVEPOINT cockroach_restart 2020-08-17 14:29:32,950 INFO sqlalchemy.engine.base.Engine {} 2020-08-17 14:29:32,952 INFO sqlalchemy.engine.base.Engine SELECT accounts.id AS accounts_id, accounts.balance AS accounts_balance FROM accounts WHERE accounts.id = %(id_1)s 2020-08-17 14:29:32,952 INFO sqlalchemy.engine.base.Engine {'id_1': 95435663} 2020-08-17 14:29:32,955 INFO sqlalchemy.engine.base.Engine UPDATE accounts SET balance=%(balance)s WHERE accounts.id = %(accounts_id)s 2020-08-17 14:29:32,956 INFO sqlalchemy.engine.base.Engine {'balance': 484504, 'accounts_id': 95435663} 2020-08-17 14:29:32,958 INFO sqlalchemy.engine.base.Engine UPDATE accounts SET balance=(accounts.balance + %(balance_1)s) WHERE accounts.id = %(id_1)s 2020-08-17 14:29:32,959 INFO sqlalchemy.engine.base.Engine {'balance_1': 484503, 'id_1': 756738049} 2020-08-17 14:29:32,961 INFO sqlalchemy.engine.base.Engine RELEASE SAVEPOINT cockroach_restart 2020-08-17 14:29:32,961 INFO sqlalchemy.engine.base.Engine {} 2020-08-17 14:29:32,966 INFO sqlalchemy.engine.base.Engine COMMIT
  1. Check the status of the application
docker-compose ps
 Name Command State Ports ---------------------------------------------------------------------------------------------------------------------------------------- kdc /start.sh Up lb /docker-entrypoint.sh hapr ... Up 0.0.0.0:26257->26257/tcp, 5432/tcp, 0.0.0.0:8080->8080/tcp, 0.0.0.0:8081->8081/tcp roach-0 /cockroach/cockroach.sh st ... Up 26257/tcp, 8080/tcp roach-1 /cockroach/cockroach.sh st ... Up 26257/tcp, 8080/tcp roach-2 /cockroach/cockroach.sh st ... Up 26257/tcp, 8080/tcp roach-cert /bin/sh -c tail -f /dev/null Up web ./sqlalchemy/start.sh Up 0.0.0.0:8000->8000/tcp
  1. Connect to CockroachDB and check whether accounts are populated
docker exec -it roach-0 sh
cockroach sql --certs-dir=/certs --host=lb # # Welcome to the CockroachDB SQL shell. # All statements must be terminated by a semicolon. # To exit, type: \q. # # Server version: CockroachDB CCL v20.1.4 (x86_64-unknown-linux-gnu, built 2020/07/29 22:56:36, go1.13.9) (same version as client) # Cluster ID: 333acd7f-ec6e-4e47-9b92-4130c8aad13b # Organization: Cockroach Labs - Production Testing # # Enter \? for a brief introduction. # root@roach-0:26257/defaultdb> select * from bank.accounts; id | balance ------------+---------- 28585249 | 269455 76361884 | 638333 ... 997258425 | 181144 (100 rows) Time: 2.1635ms root@roach-0:26257/defaultdb> \q

NOTE

Both root user using cert and sqlalchemy user using GSSAPI are leveraging hostssl connection, even though we specified host all all ... in our hba_conf config. To see that, take a look at enabling authentication logs and then inspect the logs.

I200817 19:06:12.898466 2878 sql/pgwire/conn.go:226 [n1,client=172.28.1.7:56844,hostssl,user=sqlalchemy] 14 session terminated; duration: 240.3243ms

The hostssl attempts to authenticate only when connection is made with SSL encryption.