v1.1.7

Changelog

bb45c07 add cna folder and new function to match date for cna
f9c19d0 add cna link fetcher and pass test.
a07d6aa add ignore via title words.
dd7b8c2 add new site entrance and modify ltn.com.tw entrance link.
1d12497 cna SetBody done.
7f1db2e cna fetch range committed.
0489467 cut script and blockquote elements
4178c4b date fmt pass test.
6c28284 err msg optimized.
9042e38 fix date get error.
4852a29 fix link and h2 text lost
4a2997e fix post ignore keywords error
36fb1b3 need to fetch H2 content.
6741378 set and save cna post pass test.
874f276 update test case

v1.1.6

Changelog

06800b5 add ltn
e2cda9a filter ltn content
fc15d0d fix strong text filtered.
95b0bdf rm files with same title saved before.

v1.1.5

Changelog

7440b3d Errlog no use now.
6881e40 Merge branch 'bugfix' into dev
eb9e161 add
f1b844e add defer+recover to treat panic error
bf1f558 add entrances
7b6ee34 add func
237e8da add test case url
b522317 add zaobao
7ec36d4 add zaobao, title body get done.
7d56503 dev pause
89c2441 extend links range
a292ed8 fetch links for zaobao.com
c140227 fix panic
870881c fix wrong test case.

v1.1.4

Changelog

6881e40 Merge branch 'bugfix' into dev
f1b844e add defer+recover to treat panic error
7d56503 dev pause
05ae01a dwnews now ignore pic info text.
807a1ed extend dwnews scopes.
eeaa098 fix bug: p.DOC nil panic.
a8a7a9e fix dwnews title verbose
f3e92e4 rm comments unuseful
c79e280 rm title keyword and ignore pic news.

v1.1.3

Changelog

19eea6c Merge branch 'bugfix'
05ae01a dwnews now ignore pic info text.
fd05732 expand filename date scopes.
742d005 expand filename scopes.
807a1ed extend dwnews scopes.
dbed38e fix bug: nil pointer deference in Voa
a8a7a9e fix dwnews title verbose
f3e92e4 rm comments unuseful
f41c01a rm func for merge from master.
c79e280 rm title keyword and ignore pic news.
b2bf6a2 simplify main.go
f4023c0 test delroutine now.

v1.1.2

Changelog

a25074d append original url to bottom of every txt.
bf94800 fix bug: DelRoutine not del anything.
9d2e17f fix bug: DelRoutine not del everything.
ea1b7f5 fix bug: content fetch imcomplete.
ef90427 fix bug: not del too old files by DelRoutine.
cd24447 mod update
fcab9f4 pause
5c0ff35 pause
8790a22 rfa buf fix pause
b46e674 sort fetch list.

v1.1.1

Changelog

8cf3321 expand the scope of voa links extracting.
0e99b1e expanding site enters.
b5dc6b7 fix boxun title garbled.
7cf5b0c fix bug of Extract urls not belong to the site
d92d437 fix panic index out of range

v1.1.0

Changelog

5441b7b Merge branch 'bugfix' into dev
7c9afe1 Merge branch 'dev' of https://github.com/wedojava/fetcher into dev
d2a00e5 add filter for twitter text
0102429 add func MetasByName and pass test
2313802 add rfa and pass test.
456fff9 add rfa and pass test.
ab007df don't save picture info text to the body
cb20932 dwnews pass test.
4559376 extract boxun title get func.
bce242f fix dwnews fetch null after bold text
f7a80fc fix imcomplete fetch for some rfa news.
4ab5111 mv nodes opt func to htmldoc
1c72c21 refactory step 1 done, treat boxun post pass test.
29357c3 rename func
1ef5cee rm no need files, second refactory done.
d25fdb6 save err info to post body if error occur
818aa32 voa add and pass test

v1.0.1

Changelog

d2a00e5 add filter for twitter text
ab007df don't save picture info text to the body
48a7b92 fix double line written in Dwnews() function. rm unused test file.
ea8ebc0 fix title garbled
d25fdb6 save err info to post body if error occur

v1.0.0

Changelog

fdb8265 Export funcs for invoke in main.
5f76826 Rfa SetBody pass test
b08e383 Rfa pass test
5e6fa6f SetBody() method pass test
c8b4fc9 add SetLinks and Boxun style.
12c8628 add and optimized.
bfaa7c3 add but no pass test.
9f41288 add del routine
95070ea add err log func but not pass test
59d64f2 add filename to body content.
ae1eb5f add filter on title to filter out illegal chars.
b0e0543 add funcs to deal with html body get and format, need to be tested.
95c3b0a add function to fetch node for voa, it can get elements by tag name and class string
bffb3e9 add op of
7be342d add test case
468d2ee beautify err display
8cb49e6 beautify err display
40646b1 comment print date
3749572 comment print links.
a06db3d dev pause and continue soon at stuff room.
7cb7d8a dev paused at stuff room.
be03a0b dwnews body fetcher pass test that implemented via x/net/html pkg
6ee7003 fetcher factory and actions pass test, but post factory need code.
613f410 filter links
5862b88 fix Boxun fetch body nil.
2461e2d fix bug of regex match err while fetch boxun
1f283e2 fix bug.
67ede28 fix rfa fetcher just got only first tag
81a96b3 fix title mutiple error, now just get the first one.
4cc2058 just todo
0e99466 links kickout function update
460761b modify DOC and Raw get funcs.
c043e53 modify funcs to merge raw and html.Node get functions.
30e491c modify to append links only match the right domain.
e8e043c mv link about funcs and mothods to links.go
d859b10 needed to test if save right.
3b8b334 no sence.
aa750c3 optimized for Dwnews and voa function was done, just need to be tested.
e8a37cb optimized boxun fetcher
8a48296 pass boxun date
859d3af pause
cdae46f pause for lunch
df44416 remove no need comment function. add body convert to utf8 for boxun
854fad8 rename boxun about folders.
5146820 rename kickout func
7558912 rename url parameter to _url and write done kickoutlinks func with pass test.
265d532 rewrite and use new funcs to get title from header of html.
b0555b3 rfa body fetching test passed.
df914ab rm redundant folders
d7f5a64 rm reference old code
5f68d3a running good, pass test.
5a1ef95 start dev new edition.
d18edfd thinking func value implement.
f756c1d to make it running
7af6dbf update
367dd70 update
35596aa update ErrLog function.
e2b7a1e update pkg gears
5b1cab0 update utf8 convert func
1954b83 upgrade Fetcher struct
346a08f voa pass test, PostSave will rewrite if file exist to keep it newest.
59b40f7 write done links fetch func and test pass.
5be2e77 written funcs to set raw and htmlbody