Skip to content

Convert JSON to Parquet with AWS Lambda. Streamlined data processing for efficient integration.

Notifications You must be signed in to change notification settings

Gabrielllopes/lambda_json_to_parquet

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Lambda json to parquet

Harness the power of AWS Lambda to convert JSON files into Parquet format effortlessly. This project provides a streamlined solution for efficient data transformation, enabling seamless integration into your AWS workflows. Simplify your data processing pipeline with this Lambda-powered JSON to Parquet conversion.

Usage example

aws lambda invoke \
--cli-binary-format raw-in-base64-out \
--function-name json_to_parquet \
--invocation-type RequestResponse \
--payload '{"bucket_raw": "test-glue-create-table-terraform-8888", "bucket_stage": "test-stage8888", "folder": ["teste_dirr/database-test/tabela_imaginaria/20-09-2021/"]}' \
response.json

About

Convert JSON to Parquet with AWS Lambda. Streamlined data processing for efficient integration.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published