Big Data Management – Amazon Redshift implementation

Such small isssue and so big impact, almost took 4 hours to make Amazon Redshift working in IntelliJ with cluster and VPC, hah, VPC was on private internet and I was on public internet. Tried so many things. VPCE is always on private? I made it public then it started connecting. New project in making for Big Data management with Java/IntelliJ and Amazon Redshift and now completed. Its a paid account, free is not anymore successful. or free, but make account paid then some credits we can get. Free finally.

========== CONNECTING TO REDSHIFT ==========
✓ Successfully connected to Redshift!
Endpoint: jdbc:redshift://**************redshift.amazonaws.com:5439/dev
User: *******

========== DROPPING EXISTING TABLES ==========
✓ Dropped table: LINEITEM
✓ Dropped table: ORDERS
✓ Dropped table: PARTSUPP
✓ Dropped table: CUSTOMER
✓ Dropped table: PART
✓ Dropped table: SUPPLIER
✓ Dropped table: NATION
✓ Dropped table: REGION
✓ All tables dropped successfully

========== CREATING TABLES ==========
✓ Created table: REGION
✓ Created table: NATION
✓ Created table: PART
✓ Created table: SUPPLIER
✓ Created table: PARTSUPP
✓ Created table: CUSTOMER
✓ Created table: ORDERS
✓ Created table: LINEITEM
✓ All tables created successfully

========== LOADING TPC-H DATA ==========

Loading REGION from DDL data/region.sql
✓ Loaded all 5 records into REGION

Loading NATION from DDL data/nation.sql
✓ Loaded all 25 records into NATION

Loading SUPPLIER from DDL data/supplier.sql
✓ Loaded all 100 records into SUPPLIER

Loading PART from DDL data/part.sql
✓ Loaded batch 1 (500 records into PART)
✓ Loaded batch 2 (1000 records into PART)
✓ Loaded batch 3 (1500 records into PART)
✓ Loaded batch 4 (2000 records into PART)

Loading PARTSUPP from DDL data/partsupp.sql
✓ Loaded batch 1 (500 records into PARTSUPP)
✓ Loaded batch 2 (1000 records into PARTSUPP)
✓ Loaded batch 3 (1500 records into PARTSUPP)
✓ Loaded batch 4 (2000 records into PARTSUPP)
✓ Loaded batch 5 (2500 records into PARTSUPP)
✓ Loaded batch 6 (3000 records into PARTSUPP)
✓ Loaded batch 7 (3500 records into PARTSUPP)
✓ Loaded batch 8 (4000 records into PARTSUPP)
✓ Loaded batch 9 (4500 records into PARTSUPP)
✓ Loaded batch 10 (5000 records into PARTSUPP)
✓ Loaded batch 11 (5500 records into PARTSUPP)
✓ Loaded batch 12 (6000 records into PARTSUPP)
✓ Loaded batch 13 (6500 records into PARTSUPP)
✓ Loaded batch 14 (7000 records into PARTSUPP)
✓ Loaded batch 15 (7500 records into PARTSUPP)
✓ Loaded batch 16 (8000 records into PARTSUPP)

Loading CUSTOMER from DDL data/customer.sql
✓ Loaded batch 1 (500 records into CUSTOMER)
✓ Loaded batch 2 (1000 records into CUSTOMER)
✓ Loaded batch 3 (1500 records into CUSTOMER)

Loading ORDERS from DDL data/orders.sql
✓ Loaded batch 1 (500 records into ORDERS)
✓ Loaded batch 2 (1000 records into ORDERS)
✓ Loaded batch 3 (1500 records into ORDERS)
✓ Loaded batch 4 (2000 records into ORDERS)
✓ Loaded batch 5 (2500 records into ORDERS)
✓ Loaded batch 6 (3000 records into ORDERS)
✓ Loaded batch 7 (3500 records into ORDERS)
✓ Loaded batch 8 (4000 records into ORDERS)
✓ Loaded batch 9 (4500 records into ORDERS)
✓ Loaded batch 10 (5000 records into ORDERS)
✓ Loaded batch 11 (5500 records into ORDERS)
✓ Loaded batch 12 (6000 records into ORDERS)
✓ Loaded batch 13 (6500 records into ORDERS)
✓ Loaded batch 14 (7000 records into ORDERS)
✓ Loaded batch 15 (7500 records into ORDERS)
✓ Loaded batch 16 (8000 records into ORDERS)
✓ Loaded batch 17 (8500 records into ORDERS)
✓ Loaded batch 18 (9000 records into ORDERS)
✓ Loaded batch 19 (9500 records into ORDERS)
✓ Loaded batch 20 (10000 records into ORDERS)
✓ Loaded batch 21 (10500 records into ORDERS)
✓ Loaded batch 22 (11000 records into ORDERS)
✓ Loaded batch 23 (11500 records into ORDERS)
✓ Loaded batch 24 (12000 records into ORDERS)
✓ Loaded batch 25 (12500 records into ORDERS)
✓ Loaded batch 26 (13000 records into ORDERS)
✓ Loaded batch 27 (13500 records into ORDERS)
✓ Loaded batch 28 (14000 records into ORDERS)
✓ Loaded batch 29 (14500 records into ORDERS)
✓ Loaded batch 30 (15000 records into ORDERS)

Loading LINEITEM from DDL data/lineitem.sql
✓ Loaded batch 1 (500 records into LINEITEM)
✓ Loaded batch 2 (1000 records into LINEITEM)
✓ Loaded batch 3 (1500 records into LINEITEM)
✓ Loaded batch 4 (2000 records into LINEITEM)
✓ Loaded batch 5 (2500 records into LINEITEM)
✓ Loaded batch 6 (3000 records into LINEITEM)
✓ Loaded batch 7 (3500 records into LINEITEM)
✓ Loaded batch 8 (4000 records into LINEITEM)
✓ Loaded batch 9 (4500 records into LINEITEM)
✓ Loaded batch 10 (5000 records into LINEITEM)
✓ Loaded batch 11 (5500 records into LINEITEM)
✓ Loaded batch 12 (6000 records into LINEITEM)
✓ Loaded batch 13 (6500 records into LINEITEM)
✓ Loaded batch 14 (7000 records into LINEITEM)
✓ Loaded batch 15 (7500 records into LINEITEM)
✓ Loaded batch 16 (8000 records into LINEITEM)
✓ Loaded batch 17 (8500 records into LINEITEM)
✓ Loaded batch 18 (9000 records into LINEITEM)
✓ Loaded batch 19 (9500 records into LINEITEM)
✓ Loaded batch 20 (10000 records into LINEITEM)
✓ Loaded batch 21 (10500 records into LINEITEM)
✓ Loaded batch 22 (11000 records into LINEITEM)
✓ Loaded batch 23 (11500 records into LINEITEM)
✓ Loaded batch 24 (12000 records into LINEITEM)
✓ Loaded batch 25 (12500 records into LINEITEM)
✓ Loaded batch 26 (13000 records into LINEITEM)
✓ Loaded batch 27 (13500 records into LINEITEM)
✓ Loaded batch 28 (14000 records into LINEITEM)
✓ Loaded batch 29 (14500 records into LINEITEM)
✓ Loaded batch 30 (15000 records into LINEITEM)
✓ Loaded batch 31 (15500 records into LINEITEM)
✓ Loaded batch 32 (16000 records into LINEITEM)
✓ Loaded batch 33 (16500 records into LINEITEM)
✓ Loaded batch 34 (17000 records into LINEITEM)
✓ Loaded batch 35 (17500 records into LINEITEM)
✓ Loaded batch 36 (18000 records into LINEITEM)
✓ Loaded batch 37 (18500 records into LINEITEM)
✓ Loaded batch 38 (19000 records into LINEITEM)
✓ Loaded batch 39 (19500 records into LINEITEM)
✓ Loaded batch 40 (20000 records into LINEITEM)
✓ Loaded batch 41 (20500 records into LINEITEM)
✓ Loaded batch 42 (21000 records into LINEITEM)
✓ Loaded batch 43 (21500 records into LINEITEM)
✓ Loaded batch 44 (22000 records into LINEITEM)
✓ Loaded batch 45 (22500 records into LINEITEM)
✓ Loaded batch 46 (23000 records into LINEITEM)
✓ Loaded batch 47 (23500 records into LINEITEM)
✓ Loaded batch 48 (24000 records into LINEITEM)
✓ Loaded batch 49 (24500 records into LINEITEM)
✓ Loaded batch 50 (25000 records into LINEITEM)
✓ Loaded batch 51 (25500 records into LINEITEM)
✓ Loaded batch 52 (26000 records into LINEITEM)
✓ Loaded batch 53 (26500 records into LINEITEM)
✓ Loaded batch 54 (27000 records into LINEITEM)
✓ Loaded batch 55 (27500 records into LINEITEM)
✓ Loaded batch 56 (28000 records into LINEITEM)
✓ Loaded batch 57 (28500 records into LINEITEM)
✓ Loaded batch 58 (29000 records into LINEITEM)
✓ Loaded batch 59 (29500 records into LINEITEM)
✓ Loaded batch 60 (30000 records into LINEITEM)
✓ Loaded batch 61 (30500 records into LINEITEM)
✓ Loaded batch 62 (31000 records into LINEITEM)
✓ Loaded batch 63 (31500 records into LINEITEM)
✓ Loaded batch 64 (32000 records into LINEITEM)
✓ Loaded batch 65 (32500 records into LINEITEM)
✓ Loaded batch 66 (33000 records into LINEITEM)
✓ Loaded batch 67 (33500 records into LINEITEM)
✓ Loaded batch 68 (34000 records into LINEITEM)
✓ Loaded batch 69 (34500 records into LINEITEM)
✓ Loaded batch 70 (35000 records into LINEITEM)
✓ Loaded batch 71 (35500 records into LINEITEM)
✓ Loaded batch 72 (36000 records into LINEITEM)
✓ Loaded batch 73 (36500 records into LINEITEM)
✓ Loaded batch 74 (37000 records into LINEITEM)
✓ Loaded batch 75 (37500 records into LINEITEM)
✓ Loaded batch 76 (38000 records into LINEITEM)
✓ Loaded batch 77 (38500 records into LINEITEM)
✓ Loaded batch 78 (39000 records into LINEITEM)
✓ Loaded batch 79 (39500 records into LINEITEM)
✓ Loaded batch 80 (40000 records into LINEITEM)
✓ Loaded batch 81 (40500 records into LINEITEM)
✓ Loaded batch 82 (41000 records into LINEITEM)
✓ Loaded batch 83 (41500 records into LINEITEM)
✓ Loaded batch 84 (42000 records into LINEITEM)
✓ Loaded batch 85 (42500 records into LINEITEM)
✓ Loaded batch 86 (43000 records into LINEITEM)
✓ Loaded batch 87 (43500 records into LINEITEM)
✓ Loaded batch 88 (44000 records into LINEITEM)
✓ Loaded batch 89 (44500 records into LINEITEM)
✓ Loaded batch 90 (45000 records into LINEITEM)
✓ Loaded batch 91 (45500 records into LINEITEM)
✓ Loaded batch 92 (46000 records into LINEITEM)
✓ Loaded batch 93 (46500 records into LINEITEM)
✓ Loaded batch 94 (47000 records into LINEITEM)
✓ Loaded batch 95 (47500 records into LINEITEM)
✓ Loaded batch 96 (48000 records into LINEITEM)
✓ Loaded batch 97 (48500 records into LINEITEM)
✓ Loaded batch 98 (49000 records into LINEITEM)
✓ Loaded batch 99 (49500 records into LINEITEM)
✓ Loaded batch 100 (50000 records into LINEITEM)
✓ Loaded batch 101 (50500 records into LINEITEM)
✓ Loaded batch 102 (51000 records into LINEITEM)
✓ Loaded batch 103 (51500 records into LINEITEM)
✓ Loaded batch 104 (52000 records into LINEITEM)
✓ Loaded batch 105 (52500 records into LINEITEM)
✓ Loaded batch 106 (53000 records into LINEITEM)
✓ Loaded batch 107 (53500 records into LINEITEM)
✓ Loaded batch 108 (54000 records into LINEITEM)
✓ Loaded batch 109 (54500 records into LINEITEM)
✓ Loaded batch 110 (55000 records into LINEITEM)
✓ Loaded batch 111 (55500 records into LINEITEM)
✓ Loaded batch 112 (56000 records into LINEITEM)
✓ Loaded batch 113 (56500 records into LINEITEM)
✓ Loaded batch 114 (57000 records into LINEITEM)
✓ Loaded batch 115 (57500 records into LINEITEM)
✓ Loaded batch 116 (58000 records into LINEITEM)
✓ Loaded batch 117 (58500 records into LINEITEM)
✓ Loaded batch 118 (59000 records into LINEITEM)
✓ Loaded batch 119 (59500 records into LINEITEM)
✓ Loaded batch 120 (60000 records into LINEITEM)
✓ Loaded all 60005 records into LINEITEM

✓ All TPC-H data loaded successfully

wow 60005 records, so much time only to load. All queries done.

========== CLOSING CONNECTION ==========
✓ Connection closed successfully

Process finished with exit code 0

You may also like...

Popular Posts

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.