Feat/data quality#60

Open

neylsoncrepalde wants to merge 30 commits intomainfrom

feat/data-quality

Commits on Aug 20, 2021

Commits on Aug 23, 2021

feat:added workspace & acc number to crawler path
massao Mitsunaga
committed
Merge branch 'main' of github.com:MassaoMitsunaga/rony into dev
massao Mitsunaga
committed
Merge branch 'dev' of github.com:MassaoMitsunaga/rony into dev
massao Mitsunaga
committed
feat:added kinesis stream module
massao Mitsunaga
committed

Commits on Aug 24, 2021

feat:quickstart updated
massao Mitsunaga
committed

Commits on Aug 30, 2021

Commits on Sep 2, 2021

Commits on Oct 23, 2021

Commits on Nov 17, 2021

feat/data-quality - first commit
Neylson Crepalde
committed

Commits on Nov 23, 2021

first DataQuality abstract Class
Neylson Crepalde
committed
insert run abstractmethod in DataQuality class
Neylson Crepalde
committed
constroi DataQuality como um módulo da biblioteca Rony, não como gerador de código
Neylson Crepalde
committed

Commits on Nov 24, 2021

improve DataQuality abstract class
Neylson Crepalde
committed
hard coded initial Analyzer run
Neylson Crepalde
committed
WIP analyzer hard coded example is working
Neylson Crepalde
committed
separate DataQuality and DQ AbsClass. Create default SparkSession
Neylson Crepalde
committed
change version to dev .1000
Neylson Crepalde
committed
update class diagram
Neylson Crepalde
committed

Commits on Nov 25, 2021

Analyzer with config file or string expression working. Only one column methods yet
Neylson Crepalde
committed

Commits on Dec 6, 2021

doc(dq) correct parameters on write_file
Neylson Crepalde
committed

Commits on Mar 31, 2022

change json to yaml
Neylson Crepalde
committed
refactor yaml to deal with metrics with 2+ columns
Neylson Crepalde
committed

Commits on Jul 7, 2022

feat/complete analyzer jobs with all PyDeequ Analyzer methods
Neylson Crepalde
committed
doc/rony analyzer example
Neylson Crepalde
committed