I have to do a Proof of Concept (POC) with Snowflake and I am new to Snowflake and looking for advice.
Use cases:
Have to load data for 7 tables (5 dimension tables and 2 fact tables) from Microsoft Dynamics AX (On Premise) to snowflake
Two tables are big in size and having more than 150 million records
Once data loaded to Snowflake, have to create star schema model in Snowflake around 7 tables
Going to read data from Snowflake using either SSRS, Power BI or Excel.
Need to gauge:
Time taken to load the data from Source to Snowflake (Time, Resource Utilized etc)
and how the read performance is?
Row Level Security: Area manager browses Power BI Report, should only see his data and not other area manager data
Please somebody can explain steps involved to achieve above? Would be great if you can provide some supportive links and scripts.
Do I need to do following:
Load data from AX tables to a files (I think there is a limitation on file size: https://docs.snowflake.net/manuals/user-guide-getting-started.html)
Upload these files either on Amazon S3 or Azure Blob Storage and from there can load each file to Snowflake
