A project through search engine and Hadoop, based on springboot.
Update on 2018/12/20 at 21:02
1.SpringBoot loads the devtools hot update(SpringBoot加载devtools热更新)
2.@value injection properties cannot be static(@value注入属性不能是静态的)
3.The mongo driver gets the data in the database table and walks through it(mongo驱动程序获取数据库表中的数据并遍历它)
Update on 2018/12/25 at 15:33
1. The @scheduled Lucene index database was updated once /5 minutes ago(@scheduled Lucene索引数据库5分钟更新一次)
2. Mongodb is retrieved through keyword keyword search in combination with IK participle(Mongodb是通过关键词搜索结合IK分词检索的)
Update on 2018/12/26 at 11:46
1. Webmagic network spider(webmagic网络爬虫)
Update on 2018/12/27 at 11:46
1. Webmagic network spider(webmagic网络爬虫)
NationalGeographyPageProcessor Processor抓取页面
NationalGeographyPipeline 抓取网页数据,入库mongodb
NationalGeographyRepo pojo
Update on 2018/12/27 at 21:05
1. Crawling national geographic data(爬取国家地理数据)
2. code optimization Extract common part injection Service(抽取公共部分 Service注入)
3. Integrated reids (集成redis)