Is it possible to use python to create parquet files from SQL table and store to Azure Storage Account? | Sololearn: Learn to code for FREE!
New course! Every coder should learn Generative AI!
Try a free lesson
+ 1

Is it possible to use python to create parquet files from SQL table and store to Azure Storage Account?

Python for parquet file creation

5th Sep 2020, 6:25 AM
Vaibhav Survase
Vaibhav Survase - avatar
1 Answer
0
Yes. You can ingest data from a database via pandas.read_sql() https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.read_sql.html You can write via DataFrame.to_parquet() https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.to_parquet.html I am not into azure but either there is a Python library for it our you can use the requests library for calling an API
13th Jul 2021, 6:33 PM
Zen Coding
Zen Coding - avatar