This repository has been archived by the owner on Nov 30, 2018. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 4
/
Copy pathCHANGELOG.txt
54 lines (41 loc) · 2.84 KB
/
CHANGELOG.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
HBase-Writer Change Log
Current /trunk - Compatible with hadoop-core-0.20.205.0, hbase-0.90.3 & heritrix 3.1.0
Release 0.90.4 - 23.1.2012
1. Added support to change max file size.
2. Major bug fix submitted by Greg Lu, all the usages of the connection pooling functionality built into Heritrix were not being used
and instead HBase-writer was creating a new HTable objects indirectly for every page being saved. This has been fixed.
Even worse, the connections weren't being cleaned up properly and would stick around until the process was shut down.
The connections are now being closed. Thanks again to Greg Lu for the work done to fix this problem.
(Patch submitted by Greg Lu via Ryan Smith)
3. Moved all configuration options to HBaseParameters class and cleaned up naming.
(Patch submitted by Greg Lu via Ryan Smith)
4. HBaseWriterPool has been added back extending WriterPool from Heritrix, No longer using WARCWriterPool.
(Patch submitted by Greg Lu via Ryan Smith)
Release 0.90.3 - 16.11.2011
8th Release - Compatible with hadoop-core-0.20.205.0, hbase-0.90.3 & heritrix 3.1.0
1. HBaseWriterPool.java has been removed as it is no longer used, now using WARCWriterPool from Heritrix.
2. Added few more unimplemented methods in HBaseWriterProcessor to meet new Heritrix 3.1.0 interface WARCWriterPoolSettings
3. Removed deprecated methods used in configuring Hbase and changed the way of accessing Hbase Admin.
(Patch submitted by Karthik MV via Ryan Smith)
4. Improved logging and error handling by logging the entire error stack when an exception is thrown.
Release 0.9-SNAPSAHOT - 29.03.2010
7th Release - Compatible with hadoop-core-0.19, hbase-0.20.0 & heritrix 2.0.1
(Patch submitted by Greg Lu via Ryan Smith)
Release 0.20.3 - 24.10.2009
6th Release - Compatible with hadoop-0.18.2, hbase-0.18.1 & heritrix 2.0.1
(Patch submitted by Joost Ouwerkerk via Ryan Smith)
Release 0.19.1 - 24.10.2009
5th Release - Compatible with hadoop-0.18.2, hbase-0.18.1 & heritrix 2.0.1
Release 0.19.0 - 24.10.2009
4th Release - Compatible with hadoop-0.18.2, hbase-0.18.1 & heritrix 2.0.1
Release 0.18.2 - 03.12.2008
3rd Release - Compatible with hadoop-0.18.2, hbase-0.18.1 & heritrix 2.0.1
ISSUE-6 - Adding maximum content size support. If content items collected by heritrix exceed the hard-coded limit of 20MB,
then the writer will ignore fetching this item. This is to prevent HBase from hanging on large record writes.
(Patch submitted by Andrew Purtell via Ryan Smith)
ISSUE-5 - If HBase throws an exception, the Hbase-Writer is not added back to the writer pool.
(Patch submitted by Andrew Purtell via Ryan Smith)
Release 0.18.1 - 24.10.2008
2nd Release - Compatible with hadoop-0.18.1, hbase-0.18.1 & heritrix 2.0.1
Release 0.18.0 - 10.10.2008
Initial Release - Compatible with hadoop-0.18.0, hbase-0.18.0 & heritrix 2.0.1