,-.-.     ,----.                                                           
                    ,-..-.-./  \==\ ,-.--` , \   _..---.                                                
                    |, \=/\=|- |==||==|-  _.-` .' .'.-. \                                               
                    |- |/ |/ , /==/|==|   `.-./==/- '=' /                                               
                     \, ,     _|==/==/_ ,    /|==|-,   '                                                
                     | -  -  , |==|==|    .-' |==|  .=. \                                               
                      \  ,  - /==/|==|_  ,`-._/==/- '=' ,|                                              
                      |-  /\ /==/ /==/ ,     /==|   -   /                                               
                      `--`  `--`  `--`-----```-._`.___,'                                                
   ,-,--.    _,.----.                ,---.          _ __       ,----.               
 ,-.'-  _\ .' .' -   \  .-.,.---.  .--.'  \      .-`.' ,`.  ,-.--` , \  .-.,.---.   
/==/_ ,_.'/==/  ,  ,-' /==/  `   \ \==\-/\ \    /==/, -   \|==|-  _.-` /==/  `   \  
\==\  \   |==|-   |  .|==|-, .=., |/==/-|_\ |  |==| _ .=. ||==|   `.-.|==|-, .=., | 
 \==\ -\  |==|_   `-' \==|   '='  /\==\,   - \ |==| , '=',/==/_ ,    /|==|   '='  / 
 _\==\ ,\ |==|   _  , |==|- ,   .' /==/ -   ,| |==|-  '..'|==|    .-' |==|- ,   .'  
/==/\/ _ |\==\.       /==|_  . ,'./==/-  /\ - \|==|,  |   |==|_  ,`-._|==|_  . ,'.  
\==\ - , / `-.`.___.-'/==/  /\ ,  )==\ _.\=\.-'/==/ - |   /==/ ,     //==/  /\ ,  ) 
 `--`---'             `--`-`--`--' `--`        `--`---'   `--`-----`` `--`-`--`--'  

web scraper API service for the following:

• scrape recipes and ingredients data
• save data to aws s3

Get Started

• run app swagger: http://localhost:9000/

python manager.py run

• test

python manager.py test

Setup on Mac

chromedriver

• install chromedriver

brew install chromedriver
brew install Caskroom/versions/google-chrome-canary

• set environment variable $CHORME_DRIVER. ex /usr/local/bin/chromedriver

aws configure

• aws configure with ur IAM Key

# if you don't have awscli, pip install awscli
aws configure

• OR set env $AWS_ACCESS_KEY_ID, $AWS_SECRET_ACCESS_KEY

youtube api key

• set environment variable $YOUTUBE_API_KEY