Python

紀錄 Python 學習過程與應用專案

I. Basic Course

• base python syntax and operations
• inherit data format (numeric/string/list/set/tuple/dictionary)
• loop control

II. Advanced Course

• try-except
• object oriented concepts
• generator,iterator and decorator
• class encaptsulation

III. Numpy

• basic array concepts
• array manipulation such as split/stack...etc
• Numpy Ufunctions
• aggregations

IV. Pandas

• basic Series,Index and DataFrame concepts
• Series and DataFrame attributes
• DataFrame manipulations such as split/slice...etc
• DateFrame Ufuncs

V. 基礎網路爬蟲(WebCrawling)

• requests/BeautifulSoup/re/Selenium module
• Log-in personal Facebook account using selenium
• try to get articles on PTT BBS
• applications of scrapping skills on such as :

  591House
  Shopee
  AppleNews
  Facebook search results
  Michelin Info with GoogleSheet
  YouTube Video List Downloads

VI. 自然語言處理(NLP)

• 學習六大NLP手法:segmentation/stemming/lemmatization/tagging/parsing/sentence tokenize
• 使用scikit-learn對每一個單詞計算TF-IDF
• 使用jieba模組進行中文斷詞
• 使用Gensim套件處理文章，訓練詞向量與文字預測
• 使用Spacy做單詞的定義tagging
• 安裝cuda/cudnn以及tensorflow-gpu
• 訓練DNN模型來偵測垃圾郵件
• 使用wordcloud與jieba製作文字雲

VII. Line機器人

• 使用IFTTT和twstock模組抓取股票資訊並連結到個人Line通知