Driver version

redshift-connector==2.0.903

Redshift version

PostgreSQL 8.0.2 on i686-pc-linux-gnu, compiled by GCC gcc (GCC) 3.4.2 20041017 (Red Hat 3.4.2-6.fc3), Redshift 1.0.34928

Client Operating System

Windows 10 ProBuild 19042.631

Python version

Python 3.7.3

Table schema

Problem description

Expected behaviour

1. Open a redshift_connector connection object: rs_cnx
2. query table using rs_cnx and receive result set of cardinality X
3. New data is inserted to table by external process
4. query table using rs_cnx and receive result set of cardinality > X

Actual behaviour

1. Open a redshift_connector connection object: rs_cnx
2. query table using rs_cnx and receive result set of cardinality X
3. New data is inserted to table by external process
4. query table using rs_cnx and receive result set of cardinality == X

Other details

If the redshift_connector connection object is closed and reopened between queries, then the expected behaviour occurs.

Python Driver trace logs

Reproduction code

import time import pandas as pd import redshift_connector query = "select * from db.table where symbol = 'symbol_name';" rs_cnx = redshift_connector.connect( host="hostname", user="username", password="password", database="db" ) try: # initial query df = pd.read_sql(query, con=rs_cnx) print(df.shape) with rs_cnx.cursor() as cursor: cursor.execute(query) print(len(cursor.fetchall())) # wait for new data to be inserted time.sleep(20) # re-query df = pd.read_sql(query, con=rs_cnx) print(df.shape) with rs_cnx.cursor() as cursor: cursor.execute(query) print(len(cursor.fetchall())) finally: rs_cnx.close()