13 questions
-2 votes
1 answer
159 views
How to Enable Parallel Threads for Copying non-numeric Data from SQL Server to Azure Storage
I'm attempting to copy a table from an on-premises SQL Server to Azure Storage using a data pipeline in Fabric. The table consists of 5 columns and 1000 rows, with all columns being of type varchar. ...
1 vote
2 answers
112 views
Partition mysql table on varchar column
I Have a mysql(v8.x) table with 4 Billion records and I need to partition on one of the varchar column. Partition on date column or integer column doesn't work in this case. This is a unique usecase. ...
1 vote
1 answer
265 views
MySQL RANGE table partitioning by months for 2 years records
I'm exploring on MySQL table partitioning and I have a table which have 2 years of records. I'm trying to create a new table which is similar to the current table I have so that I can copy the data ...
1 vote
1 answer
834 views
POSTGRES - Range Partitioning
I have table which is already designed to partition based on month range. I am writing code in java to check all existing partitions and would create a new one when it doesnt exist. If I create a new ...
2 votes
3 answers
2k views
How to get range partition details from system catalogs
I am looking for a solution that lists all the range partition information. Tried the below query. SELECT c.relname as partition_list,p.relname as parent_tbl FROM pg_inherits i JOIN pg_class p ON i....
0 votes
1 answer
886 views
Should I create a partition on a dedicated sql pool table only when there are more than 1 million rows per distribution?
I'm trying to create a new table in a dedicated SQL pool which will have approx. 43800 records each month. My questions are - Should I create month-wise partitions? When should I create a partition, ...
0 votes
0 answers
586 views
Postgresql - Optimize ordering of columns in table range partitioning with multiple columns range
I am testing with creating a data warehouse for a relatively big dataset. Based on ~10% sample of the data I decided to partition some tables that are expected to exceed memory which currently 16GB ...
1 vote
1 answer
1k views
Partitions by Range with two columns in Kudu table
I'm trying to create a kudu table partitioned by hash and by range with 2 variables (year, month), My problem is that I want to make biannual range partitions, without add more columns in the table. ...
1 vote
0 answers
801 views
Attach Partition takes more time even after adding check constraint
So basically we have a very large table in Postgres 11 DB which has hundreds of millions of data since the table was added. Now we are trying to convert it into a range based partition table based on ...
0 votes
1 answer
371 views
Invalid datatype for range function
I am trying to use range partition on a table for a column of type number. However, Oracle 12c throws an error saying it is an invalid data-type. I don't understand why/what is invalid in the command. ...
0 votes
1 answer
3k views
How to create multiple column partitions for postgresql db, one for time range and one for specific sensor ID?
I have one application to store and query the time series data from multiple sensors. The sensor readings of multiple months needed to be stored. And we also need add more and more sensors in the ...
0 votes
1 answer
684 views
SQL Server partitions: finding min / max value from metadata (i.e. sys.partition_range_values) rather than the table itself
I've an unique requirement for finding min / max value from a partition's range values. The idea is to gain on response time by querying metadata rather than the table itself. for e.g. I've a table ...
0 votes
1 answer
1k views
IMPALA - How to get range partition size
For Parquet table I use SHOW FILES IN db_name.parquet_table_name to get all my partitions names, size and path for my Parquet table. For Range partitions I use SHOW RANGE PARTITIONS db_name....