Skip to content

Latest commit

 

History

History
1287 lines (1134 loc) · 61.3 KB

RELEASE_NOTES.md

File metadata and controls

1287 lines (1134 loc) · 61.3 KB
Raw

Apache IoTDB 0.14.0-preview1

The 0.14.0-preview1 version only contains the new cluster version.

New Features

  • The new cluster contains two types of nodes: ConfigNode, DataNode
  • Support ConfigNode Deploy: Start(Add), Stop
  • Support DataNode Deploy: Start(Add), Stop
  • Data and Schema replication management
  • Support Consensus Protocol: Standalone, MultiLeader, Ratis
  • Schema Management: Memory, SchemaFile, RocksDB
  • Cluster monitor sql: show cluster, show regions
  • Administration: User, Permission, Role management
  • Authorization when login and executing a command
  • Load Balance for data and schema
  • Native API for reading and writing
  • Support CSV import/export tools
  • Support create/show/count/delete Storage Group
  • Support create/show/count timeseries
  • Support show/count devices
  • Flush is supported in cluster
  • Support monitor DataNode and ConfigNode through Prometheus and Grafana
  • Support Data insertion and deletion
  • Query Types: Raw data Query, Aggregation, Group By Time, Group By Level, Last query
  • Support Fill null values in the query result
  • Support order by time and limit, offset, slimit, soffset
  • Support value filter and expression
  • Python API: Add support for DBAPI

Incompatible changes

  • Rename the following scripts and configuration files
Previous Now
conf/iotdb-engine.properties conf/iotdb-datanode.properties
conf/iotdb-env.sh & bat conf/datanode-env.sh & bat
  • Rename the DataNode configuration parameters
Previous Now
internal_ip internal_address
target_confignode / config_nodes target_config_nodes
  • Rename the ConfigNode configuration parameters
Previous Now
target_confignode / config_nodes target_config_nodes

Acknowledgements:

543202718, 23931017wu, Alima777, Beyyes, Bigreybear, cchen1115, chaow, Chengjianyun, ChengShengHan, ChenSiHou, Choubenson, chuchaofan, ChuShaoHuan, Cigarl, CloudWise-Lukemiao, Cmlmakahts, Cornmonster, Cpaulzy, CRZbulabula, dafei1288, Ericpai, Flashzxi, FrankHWD, greenhandatsjtu, HeimingZ, HTHou, huanhuanerer, huzk8, irvine0109, iskytek, JackieTien97, jamber001, JerryZhangZZY, jiazhiren, jixuan1989, jun0315, Krystal-xiao, leety1228, leonardodalinky, Liuminghui233, LIU-WEI-git, ljn55966005, lyssom, MarosZyk, MinaQin, MrQuanzy, Mychaow, Noorall, OneSizeFitsQuorum, Plutooooooo, Qiaojialin, RYH61, Samperson1997, SilverNarcissus, SpriCoder, SteveYurongSu, swpulk, SzyWilliam, THUMarkLau, tisonkun, trin1t, Tsunghanjacktsai, wallezhang, wangchao316, wanghui42, wayblink, Wei-hao-Li, Xiaoyehanren, Xingtanzjr, Xinzhongtianxia, Xuanronaldo, Yifuzhou, Yschengzi, Yuyuankang, yyt86, ZhanGHanG9991, zjx1230

Apache IoTDB 0.13.0

New Features

  • [IOTDB-924] Support insert multi rows in SQL
  • [IOTDB-959] Add Create Storage Group Grammar
  • [IOTDB-1037] set rpc_compression as a parameter in JDBC URL
  • [IOTDB-1059] Support sql statement insert without timestamp
  • [IOTDB-1143] Support Continuous query
  • [IOTDB-1199] Support aligned timeseries and schema template
  • [IOTDB-1319] Support Trigger
  • [IOTDB-1391] Add a new Aggregation function extreme (max absolute value)
  • [IOTDB-1399] Add a session interface to connect multiple nodes
  • [IOTDB-1400] Support arithmetic operations in SELECT clauses
  • [IOTDB-1403] Dictionary encoding for TEXT
  • [IOTDB-1490] Add built-in UDTFs: sinh, conh, tanh
  • [IOTDB-1514] Support null in insertTablet
  • [IOTDB-1524] Support SELECT ... INTO ... clause
  • [IOTDB-1647] Nested Expressions in SELECT clauses
  • [IOTDB-1673] CLI upgrade to JLine3
  • [IOTDB-1739] Constant timeseries generating functions (const, pi and e)
  • [IOTDB-1760] Support avg, count, extreme, first_value, last_value, max_time, max_value, min_time, min_value, sum aggregations in group by fill
  • [IOTDB-1761] Add metric framework for IoTDB
  • [IOTDB-1775] Add CAST function to convert data type
  • [IOTDB-1823] Support group by multi level
  • [IOTDB-1844] Query support timeseries prefix and suffix matching: root.*sg*
  • [IOTDB-1859] Support REST API
  • [IOTDB-1860] New Grafana plugin
  • [IOTDB-1886] Support Constant Expressions in Select Clauses
  • [IOTDB-1973] Supports aggregate queries, constants, and arithmetic nested expressions in SELECT clauses
  • [IOTDB-1986] Support select UDF as alisa clauses
  • [IOTDB-1989] Spark-IoTDB-connector support inserting data
  • [IOTDB-2131] Support previous, linear, constant value fill funtion New fill
  • [ISSUE-3811] Provide a data type column for the last query dataset
  • add rabbitmq example

Improvements

  • [IOTDB-1280] Rewrite the Antlr grammar file
  • [IOTDB-1372] Enhance management of TsFileResource
  • [IOTDB-1428] Ask query threads to quit if query is timeout
  • [IOTDB-1450] Deletion should only delete related time partitions
  • [IOTDB-1463] Implement builder pattern for Session and SessionPool
  • [IOTDB-1477] Optimize code logic of generateAlignByDevicePlan()
  • [IOTDB-1559] Refactor the IT framework
  • [IOTDB-1564] Make hearbeat and election timeout parameters be configurable
  • [IOTDB-1581] Consider deletions when recovering tsFileResource of incomplete tsfile
  • [IOTDB-1607] Optimize Tracing
  • [IOTDB-1613] Recover mods file if write modification failed
  • [IOTDB-1639] Refactoring the cluster class structure to make it consistent with the server module
  • [IOTDB-1730] client-cpp, enhance session::insertTablet() etc.'s performance
  • [IOTDB-1852] Accelerate queryies by using statistics
  • [IOTDB-1857] Remove useless handle logic for CountPlan in executeNonQuery in cluster module
  • [IOTDB-1884] Distinguish between zero and null values in sum aggregation
  • [IOTDB-1924] Remove the operation of clearing the cache after the compaction is over
  • [IOTDB-1950] Add Bloom Filter cache for query
  • [IOTDB-2001] Remove redundant StorageGroupNotReadyException
  • [IOTDB-2011] Update last cache while doing show latest timeseries query
  • [IOTDB-2022] SessionDataSet implements AutoCloseable
  • [IOTDB-2075] Accelerate the process of insertTablets by using thread pool
  • [IOTDB-2119] IoTDB CSV export tools add timestamp accuracy setting function
  • [IOTDB-2162] Simplify the recovery merge process
  • [IOTDB-2176] Limit target chunk size when performing inner space compaction
  • [IOTDB-2193] Reduce unnecessary lock operations of RaftLogManager to improve writing performance
  • [IOTDB-2195] Control the concurrent query execution thread
  • [IOTDB-2632] Set compaction_write_throughput_mb_per_sec to 16 by default
  • [ISSUE-3445] New compaction strategy and compaction scheduling strategy
  • [ISSUE-3856] refine exception handling logic in commitTo in RaftLogManager
  • [Cluster] No need to shake hands with itself when one node restart

Incompatible changes

  • [IOTDB-1026] Support wildcard ** in Path And Replace PrefixPath usage with PathPattern in IOTDB-SQL
  • [IOTDB-1620] Support backtick (`) character and double quotes (") to quote identifiers
  • [IOTDB-1650] Rename the sql command move to unload

Miscellaneous changes

  • [IOTDB-1342] modify error message about LIMIT and OFFSET used in conjunction with the FILL clause
  • [IOTDB-1372] delete devices field in FileTimeIndex
  • [IOTDB-1531] Check tsfile creation time when recovering
  • [IOTDB-1541] Change sequence of wal and memtable in insertion
  • [IOTDB-1923] Separate the request unpacking and execution processing logic of TSServiceImpl
  • [IOTDB-1969] Remove statistic resources of old metric framework from iotdb-server
  • [IOTDB-2014] MicrometerPrometheusReporter#getReporterType return null
  • [IOTDB-2043] refactor: remove haveSorted param from Session
  • [IOTDB-2154] add TsFileUtils.isTsFileComplete
  • [IOTDB-2206] Rename StorageGroupProcessor to VirtualStorageGroupProcessor
  • [IOTDB-2208] Reconstruct the process of generating resultset header of query
  • [ISSUE-4047] Generic type in Statistics extend Serializable
  • Add compaction version in cache key
  • Add a constructor of IoTDBDescriptorHolder to prohibit instantiation

Bug Fixes

  • [IOTDB-1266] Fix SHOW TIMESERIES will only display 2000 timeseries
  • [IOTDB-1478] The whole IoTDB can not read/write if any one sg is not ready
  • [IOTDB-1562] Fix incorrect exception processing in insertXXX() API
  • [IOTDB-1583] Raft log failed to be committed in cluster version
  • [IOTDB-1592] BugFix: SLimit Not effective in align by device
  • [IOTDB-1736] Fix error code is not printed in TSServiceImpl's log
  • [IOTDB-1749] sync-tool's lockInstance() dose not take effect
  • [IOTDB-1758] sync-tool, empty uuid file cause tool can not auto-recovery
  • [IOTDB-1848] Failed to initialize pool: Does not support setReadOnly in grafana-connector
  • [IOTDB-1853] Fix bug about more than one TimeseriesMetadata in TsFile
  • [IOTDB-2010] fix incomplete show timeseries result
  • [IOTDB-2021] Fix Bloom Filter Cache doesn't take effect bug
  • [IOTDB-2060] Fix NPE when using fill without a filter
  • [IOTDB-2074] Fix NullPointerException when recovering compaction in MacOS
  • [IOTDB-2077] Unexpected exception when executing raw data query without VF with limit clause
  • [IOTDB-2088] Fix IndexOutOfBound exception in AggregationPlan.groupAggResultByLevel
  • [IOTDB-2116] Fix all client connections are stuck bug caused by logback bug
  • [IOTDB-2129] Wrong result returned when querying by nested expressions with aliases
  • [IOTDB-2143] fix wrong precision in cluster mode
  • [IOTDB-2153] [IOTDB-2157] fix incorrect path search space
  • [IOTDB-2159] Fix wrong status code when inserting data to a read-only cluster
  • [IOTDB-2163] Fix unexpected amount of columns in a cluster slimit query
  • [IOTDB-2174] Fix Regexp filter serializing and deserializing error
  • [IOTDB-2180] Fix show latest timeseries in cluster
  • [IOTDB-2183] Fix the config problems in cluster mode
  • [IOTDB-2185] Fix get an exception when parsing the header of CSV
  • [IOTDB-2209] Fix logback CVE-2021-42550 issue
  • [IOTDB-2251] [IOTDB-2252] Fix Query deadlock
  • [IOTDB-2267] UDF: Error code 500 caused by user logic
  • [IOTDB-2282] fix tag recovery bug after tag upsert
  • [IOTDB-2290] Fix Incorrect query result in C++ client
  • Fix CPP client could not be successfully built on windows
  • Fix dead lock in setDataTTL method

Apache IoTDB 0.12.4

New Features

  • [IOTDB-1823] group by multi level

Improvements

  • [IOTDB-2027] Rollback invalid entry after WAL writing failure
  • [IOTDB-2061] Add max concurrent sub query parameter, read data in batches to limit max IO and add max cached buffer size configuration
  • [IOTDB-2065] release TsFileSequenceReader soon when it is no longer used
  • [IOTDB-2072] Remove TVListAllocator to reduce the TVList mem cost
  • [IOTDB-2101] Reduce the memory footprint of QueryDataSource
  • [IOTDB-2102] Push limit operator down to each reader
  • [IOTDB-2123] Accelerate recovery process
  • update user guide for cpp-cpi and disable compiling nodejs in cpp-cli
  • Ignore too many WAL BufferOverflow log

Bug Fixes

  • [IOTDB-1408] Statement with 'as' executes incorrectly in mutil-path scenes
  • [IOTDB-2023] Fix serializing and deserializing bugs of Filters
  • [IOTDB-2025] Fix count nodes and devices incorrectly in cluster
  • [IOTDB-2031] Fix incorrect result of descending query with value filter in cluster
  • [IOTDB-2032] Fix incorrect result of descending query with multiple time partitions
  • [IOTDB-2039] Fix data redundant after too many open files exception occurs during compaction
  • [IOTDB-2047] Fix NPE when memControl is disabled and insert TEXT value to a non-TEXT series
  • [IOTDB-2058] Fix Query is blocked without sub-query-threads exist bug
  • [IOTDB-2063] Fix MinTimeDescAggregationResult implementation bug
  • [IOTDB-2064] Fix the NPE caused by map serde
  • [IOTDB-2068] Fix GZIP compressor meets ArrayIndexOutOfBoundsException
  • [IOTDB-2124] the filtering condition does not take efffect for last query in cluster
  • [IOTDB-2138] Fix data loss after IoTDB recover
  • [IOTDB-2140] Fix merge throw NullPointerException
  • [IOTDB-2152] PyClient: Override __eq__() of TSDataType, TSEncoding and Compressor to avoid unexpected comparation behaviour
  • [IOTDB-2160] Fix cluster groupby query cross-node reference leaks
  • [ISSUE-3335] Fix the bug of start-cli.sh -e mode can't work with wild card *
  • fix memory leak: replace RandomDeleteCache with Caffine CacheLoader
  • Fix connection refused using session when users forget to set client ip

Apache IoTDB 0.12.3

Improvements

  • [IOTDB-842] Better Export/Import-CSV Tool
  • [IOTDB-1738] Cache paths list in batched insert plan
  • [IOTDB-1792] remove tomcat-embed dependency and make all transitive dependencies versions consistent
  • [ISSUE-4072] Parallel insert records in Session
  • Print the file path while meeting error in case of reading chunk

Bug Fixes

  • [IOTDB-1275] Fix backgroup exec for cli -e function causes an infinite loop
  • [IOTDB-1287] Fix C++ class Session has 2 useless sort()
  • [IOTDB-1289] fix CPP mem-leak in SessionExample.cpp insertRecords()
  • [IOTDB-1484] fix auto create schema in cluster
  • [IOTDB-1578] Set unsequnce when loading TsFile with the same establish time
  • [IOTDB-1619] Fix an error msg when restart iotdb-cluster
  • [IOTDB-1629] fix the NPE when using value fill in cluster mode
  • [IOTDB-1632] Fix Value fill function fills even when the data exists
  • [IOTDB-1651] add reconnect to solve out of sequence in sync module
  • [IOTDB-1659] Fix Windows CLI cannot set maxPRC less than or equal to 0
  • [IOTDB-1670] Fix cli -e mode didn't fetch timestamp_precision from server
  • [IOTDB-1674] Fix command interpret error causing somaxconn warning failed
  • [IOTDB-1677] Fix not generate file apache-iotdb-0.x.x-client-cpp-linux-x86_64-bin.zip.sha512
  • [IOTDB-1678] Fix client-cpp session bug: can cause connection leak.
  • [IOTDB-1679] client-cpp: Session descontruction need release server resource
  • [IOTDB-1690] Fix align by device type cast error
  • [IOTDB-1693] fix IoTDB restart does not truncate broken ChunkGroup bug
  • [IOTDB-1703] Fix MManager slow recover with tag
  • [IOTDB-1714] fix Could not find or load main class when start with jmx on win
  • [IOTDB-1723] Fix concurrency issue in compaction selection
  • [IOTDB-1726] Wrong hashCode() and equals() method in ChunkMetadata
  • [IOTDB-1727] Fix Slow creation of timeseries with tag
  • [IOTDB-1731] Fix sync error between different os
  • [IOTDB-1733] Fix dropping built-in function
  • [IOTDB-1741] Avoid double close in level compaction execution
  • [IOTDB-1785] Fix Illegal String ending with . being parsed to PartialPath
  • [IOTDB-1836] Fix Query Exception Bug after deleting all sgs
  • [IOTDB-1837] Fix tagIndex rebuild failure after upgrade mlog from mlog.txt to mlog.bin
  • [IOTDB-1838] The compacting status in SGP is always false
  • [IOTDB-1846] Fix the error when count the total number of devices in cluster mode
  • [IoTDB-1847] Not throw excpetion when pulling non--existent time series
  • [IOTDB-1850] Fix deserialize page merge rate limiter
  • [IoTDB-1865] Compaction is blocking when removing old files in Cluster
  • [IOTDB-1868] Use RwLock to reduce the lock time for nodeRing
  • [IOTDB-1872] Fix data increases abnormally after IoTDB restarts
  • [IOTDB-1877] Fix Sync recovery and reconnection bugs in both sender and receiver
  • [IOTDB-1879] Fix some Unsequence files never be merged to higher level or Sequence folder
  • [IOTDB-1887] Fix importing csv data containing null throws exception
  • [IOTDB-1893] Fix Can not release file lock in sync verify singleton
  • [IOTDB-1895] Cache leader optimization for batch write interfaces on multiple devices
  • [IOTDB-1903] Fix IndexOutOfRangeException when starting IoTDB
  • [IoTDB-1913] Fix When exporting a amount of data from csv, it will report network error or OOM
  • [IOTDB-1925] Fix the modification of max_select_unseq_file_num_in_each_compaction parameter does not take effect
  • [IOTDB-1958] Add storage group not ready exception
  • [IOTDB-1961] Cluster query memory leak
  • [IOTDB-1975] OOM caused by that MaxQueryDeduplicatedPathNum doesn't take effect
  • [IOTDB-1983] Fix DescReadWriteBatchData serializing bug
  • [IOTDB-1990] Fix unchecked null result by calling IReaderByTimestamp.getValuesInTimestamps()
  • [ISSUE-3945] Fix Fuzzy query not support multiDevices and alignByDevice Dataset
  • [ISSUE-4288] Fix CI issue caused by the invalid pentaho download url
  • [ISSUE-4293] SessionPool: InterruptedException is not properly handled in synchronized wait()
  • [ISSUE-4308] READ_TIMESERIES privilege granted to users and roles can not take effect when quering by UDFs
  • fix merge ClassCastException: MeasurementMNode
  • change sync version check to major version
  • init dummyIndex after restart cluster

Apache IoTDB 0.12.2

New Features

  • [IOTDB-959] Add create storage group Grammar
  • [IOTDB-1399] Add a session interface to connect multiple nodes
  • [IOTDB-1466] Support device template
  • [IOTDB-1491] UDTF query supported in cluster
  • [IOTDB-1496] Timed flush memtable
  • [IOTDB-1536] Support fuzzy query REGEXP
  • [IOTDB-1561] Support fill by specific value
  • [IOTDB-1565] Add sql: set system to readonly/writable
  • [IOTDB-1569] Timed close TsFileProcessor
  • [IOTDB-1586] Support mysql-style Like clause
  • [ISSUE-3811] Provide a data type column for the last query dataset
  • TTL can be set to the prefix path of storage group
  • add JMX monitor to all ThreadPools in the server module

Improvements

  • [IOTDB-1566] Do not restrict concurrent write partitions
  • [IOTDB-1585] ModificationFile‘s write interface blocking
  • [IOTDB-1587] SessionPool optimization: a more aggressive Session creation strategy
  • Use StringCachedPool in TsFileResource to reduce the memory size
  • write performance optimization when replicaNum == 1
  • Optimize Primitive Array Manager
  • Function Improvement: add overlapped page rate in Tracing

Bug Fixes

  • [IOTDB-1282] fix C++ class SessionDataSet mem-leak
  • [IOTDB-1407] fix Filtering time series based on tags query fails Occasionally
  • [IOTDB-1437] Fix the TsFileSketchTool NPE
  • [IOTDB-1442] Time filter & TTL do not take effect in cluster
  • [IOTDB-1452] remove compaction log/ change logger to daily
  • [IOTDB-1447] ClientPool is blocking other nodes when one node fails
  • [IOTDB-1456] Fix Error occurred while executing delete timeseries statement
  • [IOTDB-1461] Fix compaction conflicts with ttl
  • [IOTDB-1462] Fix cross space compaction recover null pointer bug
  • [IOTDB-1464] fix take byte array null pointer
  • [IOTDB-1469] fix cross space compaction lost data bug
  • [IOTDB-1471] Fix path not right in "sg may not ready" log
  • [IOTDB-1475] MeasurementId check while create timeseries or template/ disable time or timestamp in timeseries path
  • [IOTDB-1488] Fix metaMember's forwarding clientPool timeout in cluster module
  • [IOTDB-1494] fix compaction block flush bug
  • [IoTDB-1499] Remove series registration using IoTDBSink
  • [IoTDB-1501] Fix compaction recover delete tsfile bug
  • [IOTDB-1529] Fix mlog recover idx bug and synchronize setStorageGroup
  • [IOTDB-1537] fix insertTablet permission
  • [IOTDB-1539] Fix delete operation with value filter is abnormal
  • [IOTDB-1540] Bug Fix: 500 when using IN operator
  • [IOTDB-1541] Fix query result not right due to non-precise time index of resource
  • [IOTDB-1542] Cpp client segment fault: char[] buffer overflow caused by long exception message
  • [IOTDB-1545] Query dataset memory leak on server caused by cpp client
  • [IOTDB-1546] Optimize the Upgrade Tool rewrite logic to reduce the temp memory cost
  • [IOTDB-1552] Only allow equivalent filter for TEXT data type
  • [IOTDB-1556] Abort auto create device when meet exception in setStorageGroup
  • [IOTDB-1574] Deleted file handler leak
  • [IOTDB-1580] Error result of order by time desc when enable time partition
  • [IOTDB-1584] Doesn't support order by time desc in cluster mode
  • [IOTDB-1588] Bug fix: MAX_TIME is incorrect in cluster mode
  • [IOTDB-1594] Fix show timeseries returns incorrect tag value
  • [IOTDB-1600] Fix InsertRowsOfOneDevicePlan being not supported in cluster mode
  • [IOTDB-1610] Fix TsFileRewriteTool writing incorrect data file
  • [ISSUE-3116] Bug when using natural month unit in time interval in group by query
  • [ISSUE-3316] Query result with the same time range is inconsistent in group by query
  • [ISSUE-3436] Fix query result not right after deleting multiple time interval of one timeseries
  • [ISSUE-3458] fix load configuration does not take effect
  • [ISSUE-3545] Fix Time interval value is disorder in group by month
  • [ISSUE-3653] fix Max_time and last return inconsistent result
  • [ISSUE-3690] Memory leaks on the server when cpp client invokes checkTimeseriesExists
  • [ISSUE-3805] OOM caused by Chunk cache
  • [ISSUE-3865] Meaningless connection reset issues caused by low default value for SOMAXCONN
  • Fix DataMigrationExample OOM if migrate too many timeseries
  • Handle false positive cases which may cause NPE of tsfile bloom filter
  • Fix Windows shell error on JDK11 & fix iotdb-env.bat not working
  • Fix cluster auto create schema bug when retry locally
  • Fix thrift out of sequence in cluster module
  • Skip non exist measurement in where clause in align by device
  • fix blocking query when selecting TsFile in compaction
  • Fix redundant data in compaction recover
  • Fix load tsfile with time partition enable

Incompatible changes

  • [IOTDB-1485] Replace tsfile_size_threshold by unseq_tsfile_size/seq_tsfile_size

Miscellaneous changes

  • [IOTDB-1499] Remove unused exception throwing notation in IoTDBSink
  • [IOTDB-1500] Remove current dynamic query memory control
  • [ISSUE-3674] Disable thrift code generation for Javascript
  • enable cacheLeader by default
  • add audit log when execute delete and set sg for tracing
  • modify nodeTool user to root

Apache IoTDB 0.12.1

Bug Fixes

  • [GITHUB-3373] Remove the broken cached leader connection & optimize the insertRecords method in session
  • [IOTDB-1433] Fix bug in getMetadataAndEndOffset when querying non-exist device
  • [IOTDB-1432] fix level compaction loss data
  • [IOTDB-1427] Fix compaction lock with query
  • [IOTDB-1420] Fix compaction ttl bug
  • [IOTDB-1419] Remove redundant clearCompactionStatus, fix continuous compaction doesn't take effect when enablePartition
  • [IOTDB-1415] Fix OOM caused by ChunkCache
  • [IOTDB-1414] NPE occurred when call getStorageGroupNodeByPath() method using not exist path
  • [IOTDB-1412] Unclear exception message thrown when executing empty InsertTabletPlan
  • [IOTDB-1411] Fix thriftMaxFrameSize and thriftDefaultBufferSize does not in effect
  • [IOTDB-1398] Do not select unseq files when there are uncompacted old unseq files
  • [IOTDB-1390] Fix unseq compaction loss data bug
  • [IOTDB-1384] Fix group by bug
  • [ISSUE-3378] Fix NPE when clear upgrade folder; Fix some upgraded pageHeader missing statistics
  • [GITHUB-3339] Try to fix sg dead lock
  • [GITHUB-3329] Fix upgrade NPE and DeadLock
  • [GITHUB-3319] Fix upgrade tool cannot close file reader
  • [IOTDB-1212] Fix The given error message is not right when executing select sin(non_existence) from root.sg1.d1
  • [IOTDB-1219] Fix a potential NPE issue in UDF module
  • [IOTDB-1286] Fix 4 C++ mem-leak points
  • [IOTDB-1294] Fix delete operation become invalid after compaction
  • [IOTDB-1313] Fix lossing time precision when import csv with unsupported timestamp format
  • [IOTDB-1316] The importCsv tool should continue inserting if a part of insertion failed
  • [IOTDB-1317] Fix log CatchUp always failed due to not check the follower's match index
  • [IOTDB-1323] Fix return a success message when encounter RuntimeException during the insertion process
  • [IOTDB-1325] Fix StackOverflow Exception in group by natural month query
  • [IOTDB-1330] Fix the load tsfile bug when the cross multi partition's tsfile only have one page
  • [IOTDB-1348] Fix Last plan not work in cluster mode
  • [IOTDB-1376] Fix BatchProcessException was not correctly handled in BaseApplier
  • [ISSUE-3277] Fix TotalSeriesNumber in MManager counted twice when recovering
  • [ISSUE-3116] Fix bug when using natural month unit in time interval in group by query
  • [ISSUE-3309] Fix InsertRecordsOfOneDevice runs too slow
  • Fix the plan index is always zero when using insertRecords interface to run the cluster
  • Add authority check for users create timeseries using executeBatch interface without the privilege
  • Fix versionInfo NPE when query upgrading 0.11 tsfile
  • Fix upgrade tool cannot load old tsfile if time partition enabled in 0.11
  • Fix import csv throw ArrayOutOfIndexError when the last value in a line is null
  • Fix upgrade tool cannot close file reader

Improvements

  • [GITHUB-3399] Change the default primitive array size to 32
  • [IOTDB-1387] Support Without Null ALL in align by device clause, Filter RowRecord automatically if any column in it is null or all columns are null
  • [IOTDB-1385] Extract the super user to the configuration
  • [IOTDB-1315] ExportCsvTool should support timestamp yyyy-MM-dd'T'HH:mm:ss.SSSZ
  • [IOTDB-1339] optimize TimeoutChangeableTSnappyFramedTransport
  • [IOTDB-1356] Separate unseq_file_num_in_each_level from selecting candidate file in unseq compaction
  • [IOTDB-1357] Compaction use append chunk merge strategy when chunk is already large enough
  • [IOTDB-1380] Automatically close the dataset while there is no more data
  • Optimize sync leader for meta

New Features

  • [GITHUB-3389] TTL can be set to any path
  • [GITHUB-3387] Add parameter compaction_interval=10000ms
  • [IOTDB-1190] Fully support HTTP URL char set in timeseries path
  • [IOTDB-1321][IOTDB-1322] Filter RowRecord automatically if any column in it is null or all columns are null
  • [IOTDB-1357] Compaction use append chunk merge strategy when chunk is already large
  • [ISSUE-3089] Make it possible for storage groups to have name with hyphen

Miscellaneous changes

  • [GITHUB-3346] upgrade netty and claim exclusion for enforcer check
  • [IOTDB-1259] upgrade libthrift from 0.12.0/0.13.0 to 0.14.1
  • Uncomment the less used configurations
  • Enable the configration concurrent_writing_time_partition

Apache IoTDB 0.12.0

New Features

  • [IOTDB-68] New shared-nothing cluster
  • [IOTDB-507] Add zeppelin-interpreter module
  • [IOTDB-825] Aggregation by natural month
  • [IOTDB-890] support SDT lossy compression
  • [IOTDB-944] Support UDTF (User-defined Timeseries Generating Function)
  • [IOTDB-965] Add timeout parameter for query
  • [IOTDB-1077] Add insertOneDeviceRecords API in java session
  • [IOTDB-1055] Support data compression type GZIP
  • [IOTDB-1024] Support multiple aggregated measurements for group by level statement
  • [IOTDB-1276] Add explain sql support and remove debug_state parameter
  • [IOTDB-1197] Add iotdb-client-go as a git submodule of IoTDB repo
  • [IOTDB-1230] Support spans multi time partitions when loading one TsFile
  • [IOTDB-1273] Feature/restrucutre python module as well as supporting pandas dataframe
  • [IOTDB-1277] support IoTDB as Flink's data source
  • [PR-2605] Add level merge to "merge" command

Incompatible changes

  • [IOTDB-1081] New TsFile Format
  • [ISSUE-2730] Add the number of unseq merge times in TsFile name.

Miscellaneous changes

  • [IOTDB-868] Change mlog from txt to bin
  • [IOTDB-1069] Restrict the flushing memtable number to avoid OOM when mem_control is disabled
  • [IOTDB-1104] Refactor the error handling process of query exceptions
  • [IOTDB-1108] Add error log to print file name while error happened
  • [IOTDB-1152] Optimize regular data size in traversing
  • [IOTDB-1180] Reset the system log file names and maximal disk-space size
  • [ISSUE-2515] Set fetchsize through JDBC and Session
  • [ISSUE-2598] Throw explicit exception when time series is unknown in where clause
  • [PR-2944] Throw exception when device to be queried is not in TsFileMetaData
  • [PR-2967] Log memory usage information in SystemInfo for better diagnosis

Bug Fixes

  • [IOTDB-1049] Fix NullpointerException and a delete bug in Last query
  • [IOTDB-1050] Fix Count timeserise column name is wrong
  • [IOTDB-1068] Fix Time series metadata cache bug
  • [IOTDB-1084] Fix temporary memory of flushing may cause OOM
  • [IOTDB-1106] Fix delete timeseries bug
  • [IOTDB-1126] Fix the unseq tsfile delete due to merge
  • [IOTDB-1135] Fix the count timeseries prefix path bug
  • [IOTDB-1137] Fix MNode.getLeafCount error when existing sub-device
  • [ISSUE-2484] Fix creating timeseries error by using "create" or "insert" statement
  • [ISSUE-2545, 2549] Fix unseq merge end time bug
  • [ISSUE-2611] An unsequence file that covers too many sequence file causes OOM query
  • [ISSUE-2688] LRULinkedHashMap does not work as an LRU Cache
  • [ISSUE-2709, 1178] Fix cache not cleared after unseq compaction bug, Fix windows 70,10 ci bug in unseq compaction ci
  • [ISSUE-2741] getObject method in JDBC should return an Object
  • [ISSUE-2746] Fix data overlapped bug after unseq compaction
  • [ISSUE-2758] NullPointerException in QueryTimeManager.checkQueryAlive()
  • [ISSUE-2905] Fix Files.deleteIfExists() doesn't work for HDFS file
  • [ISSUE-2919] Fix C++ client memory leak bug
  • [PR-2613] Fix importCSVTool import directory bug & encode bug
  • [PR-2409] Fix import csv which can't import time format str
  • [PR-2582] Fix sync bug for tsfiles's directory changed by vitural storage group
  • [ISSUE-2911] Fix The write stream is not closed when executing the command 'tracing off'

Apache IoTDB 0.11.4

Bug Fixes

  • IOTDB-1303 Disable group by without aggregation function in select clause
  • IOTDB-1306 Fix insertion blocked caused the deadlock in memory control module
  • IOTDB-1308 Fix users with READ_TIMESERIES permission cannot execute group by fill queries
  • IOTDB-1344 Fix cannot create timeseries caused by the timeseries count doesn't reset when deleting storage group
  • IOTDB-1384 Some value will disappear while using group by query
  • IOTDB-1398 Do not select unseq files when there are uncompacted old unseq files
  • ISSUE-3316 Fix query result with the same time range is inconsistent in group by query
  • Fix TotalSeriesNumber in MManager counted twice when recovering
  • Fix unseq compaction throws a wrong exception if some paths are not in the file
  • Fix overlapped data should be consumed first exception when query

Improvements

  • IOTDB-1356 Separate unseq_file_num_in_each_level from selecting candidate file in unseq compaction
  • IOTDB-1412 Unclear exception message thrown when executing empty InsertTabletPlan
  • continuous compaction in level compaction strategy when no tsfile is to be closed

New Features

  • support brackets with number in timeseries path

Apache IoTDB 0.11.3

Bug Fixes

  • ISSUE-2505 ignore PathNotExistException in recover and change recover error to warn
  • IOTDB-1119 Fix C++ SessionDataSet bug when reading value buffer
  • Fix SessionPool does not recycle session and can not offer new Session due to RunTimeException
  • ISSUE-2588 Fix dead lock between deleting data and querying in parallel
  • ISSUE-2546 Fix first chunkmetadata should be consumed first
  • IOTDB-1126 Fix unseq tsfile is deleted due to compaction
  • IOTDB-1137 MNode.getLeafCount error when existing sub-device
  • ISSUE-2624 ISSUE-2625 Avoid OOM if user don't close Statement and Session manually
  • ISSUE-2639 Fix possible NPE during end query process
  • Alter IT for An error is reported and the system is suspended occasionally
  • IOTDB-1149 print error for -e param when set maxPRC<=0
  • IOTDB-1247 Fix the insert blocked caused the bugs in mem control module
  • ISSUE-2648 Last query not right when having multiple devices
  • Delete mods files after compaction
  • ISSUE-2687 fix insert NaN bug
  • ISSUE-2598 Throw explicit exception when time series is unknown in where clause
  • Fix timeseriesMetadata cache is not cleared after the TsFile is deleted by a compaction
  • ISSUE-2611 An unsequence file that covers too many sequence file causes OOM query
  • IOTDB-1135 Fix count timeseries bug when the paths are nested
  • ISSUE-2709 IOTDB-1178 Fix cache is not cleared after compaction
  • ISSUE-2746 Fix data overlapped bug after the elimination unseq compaction process
  • Fix getObject method in JDBC should return an Object
  • IOTDB-1188 Fix IoTDB 0.11 unable to delete data bug
  • Fix when covering a tsfile resource with HistoricalVersion = null, it’ll throw a NPE
  • fix the elimination unseq compaction may loss data bug after a delete operation is executed
  • Fix a bug of checking time partition in DeviceTimeIndex
  • Throw exeception when device to be queried is not in tsFileMetaData
  • Fix unseq compaction file selector conflicts with time partition bug
  • Fix high CPU usage during the compaction process

Improvements

  • IOTDB-1140 optimize regular data encoding
  • Add more log for better tracing
  • Add backgroup exec for cli -e function
  • Add max direct memory size parameter to env.sh
  • Change last cache log to debug level

New Features

  • Add explain sql support

Apache IoTDB 0.11.2

Bug Fixes

  • IOTDB-1049 Fix Nullpointer exception and a delete bug in Last query
  • IOTDB-1060 Support full deletion for delete statement without where clause
  • IOTDB-1068 Fix Time series metadata cache bug
  • IOTDB-1069 restrict the flushing memtable number to avoid OOM when mem_control is disabled
  • IOTDB-1077 add insertOneDeviceRecords API in java session
  • IOTDB-1087 fix compaction block flush: flush do not return until compaction finished
  • IOTDB-1106 Delete timeseries statement will incorrectly delete other timeseries
  • Github issue-2137 fix grafana value-time position bug
  • Github issue-2169 GetObject returns String for all data types
  • Github issue-2240 fix Sync failed: Socket is closed by peer
  • Github issue-2387 The deleteData method exists in Session but not in SessionPool.
  • add thrift_max_frame_size in iotdb-engine.properties
  • Fix incorrect last result after deleting all data
  • Fix compaction recover block restart: IoTDB cannot restart until last compaction recover task finished
  • Fix compaction ignore modification file: delete does not work after compaction
  • print more insert error message in client
  • expose enablePartition parameter into iotdb-engines.properpties

Apache IoTDB 0.11.1

Bug Fixes

  • IOTDB-990 cli parameter maxPRC shouldn't to be set zero
  • IOTDB-993 Fix tlog bug
  • IOTDB-994 Fix can not get last_value while doing the aggregation query along with first_value
  • IOTDB-1000 Fix read redundant data while select with value filter with unseq data
  • IOTDB-1007 Fix session pool concurrency and leakage issue when pool.close is called
  • IOTDB-1016 overlapped data should be consumed first
  • IOTDB-1021 Fix NullPointerException when showing child paths of non-existent path
  • IOTDB-1028 add MAX_POINT_NUMBER format check
  • IOTDB-1034 Fix Show timeseries error in Chinese on Windows
  • IOTDB-1035 Fix bug in getDeviceTimeseriesMetadata when querying non-exist device
  • IOTDB-1038 Fix flink set storage group bug
  • ISSUE-2179 fix insert partial tablet with binary NullPointer bug
  • add reject status code
  • Update compaction level list delete
  • Fix query result is not correct
  • Fix import errors in Session.py and SessionExample.py
  • Fix modules can not be found when using pypi to pack client-py
  • Fix Count timeseries group by level bug
  • Fix desc batchdata count bug

Apache IoTDB 0.11.0

New Features

  • IOTDB-627 Support range deletion for timeseries
  • IOTDB-670 Add raw data query interface in Session
  • IOTDB-716 add lz4 compression
  • IOTDB-736 Add query performance tracing
  • IOTDB-776 New memory control strategy
  • IOTDB-813 Show storage group under given path prefix
  • IOTDB-848 Support order by time asc/desc
  • IOTDB-863 add a switch to drop ouf-of-order data
  • IOTDB-873 Add count devices DDL
  • IOTDB-876 Add count storage group DDL
  • IOTDB-926 Support reconnection of Session
  • IOTDB-941 Support 'delete storage group '
  • IOTDB-968 Support time predicate in select last, e.g., select last * from root where time >= T
  • Show alias if it is used in query
  • Add level compaction strategy
  • Add partialInsert

Incompatible changes

  • IOTDB-778 Support double/single quotation in Path
  • IOTDB-870 change tags and attributes output to two columns with json values

Miscellaneous changes

  • IOTDB-784 Update rpc protocol to V3
  • IOTDB-790 change base_dir to system_dir
  • IOTDB-829 Accelerate delete multiple timeseries
  • IOTDB-839 Make Tablet api more friendly
  • IOTDB-902 Optimize max_time aggregation
  • IOTDB-916 Add a config entry to make Last cache configurable
  • IOTDB-928 Make ENCODING optional in create time series sentence
  • IOTDB-938 Re-implement Gorilla encoding algorithm
  • IOTDB-942 Optimization of query with long time unsequence page
  • IOTDB-943 Fix cpu usage too high
  • Add query load log
  • Add merge rate limiting

Bug Fixes

  • IOTDB-749 Avoid select * from root OOM
  • IOTDB-774 Fix "show timeseries" OOM problem
  • IOTDB-832 Fix sessionPool logic when reconnection failed
  • IOTDB-833 Fix JMX cannot connect IoTDB in docker
  • IOTDB-835 Delete timeseries and change data type then write failed
  • IOTDB-836 Statistics classes mismatched when endFile （delete timeseries then recreate）
  • IOTDB-837 ArrayIndexOutOfBoundsException if the measurementId size is not consistent with the value size
  • IOTDB-847 Fix bug that 'List user privileges' cannot apply to 'root'
  • IOTDB-850 a user could list others privilege bug
  • IOTDB-851 Enhance failure tolerance when recover WAL (enable partial insertion)
  • IOTDB-855 Can not release Session in SessionPool if RuntimeException occurs
  • IOTDB-868 Can not redo mlogs with special characters like comma
  • IOTDB-872 Enable setting timezone at client
  • IOTDB-877 fix prefix bug on show storage group and show devices
  • IOTDB-904 fix update last cache NullPointerException
  • IOTDB-920 Disable insert row that only contains time/timestamp column
  • IOTDB-921 When execute two query simultaneously in one statement, got error
  • IOTDB-922 Int and Long can convert to each other in ResultSet
  • IOTDB-947 Fix error when counting node with wildcard
  • IOTDB-949 Align by device doesn't support 'T*' in path.
  • IOTDB-956 Filter will be missed in group by time align by device
  • IOTDB-963 Redo deleteStorageGroupPlan failed when recovering
  • IOTDB-967 Fix xxx does not have the child node xxx Bug in count timeseries
  • IOTDB-970 Restrict log file number and size
  • IOTDB-971 More precise error messages of slimit and soffset
  • IOTDB-975 when series does not exist in TsFile, reading wrong ChunkMetadataList

Apache IoTDB (incubating) 0.10.1

  • [IOTDB-797] InsertTablet deserialization from WAL error
  • [IOTDB-788] Can not upgrade all storage groups
  • [IOTDB-792] deadlock when insert while show latest timeseries
  • [IOTDB-794] Rename file or delete file Error in start check in Windows
  • [IOTDB-795] BufferUnderflowException in Hive-connector
  • [IOTDB-766] Do not release unclosed file reader, a small memory leak
  • [IOTDB-796] Concurrent Query throughput is low
  • Query result is not correct when some unsequence data exists
  • Change the default fetch size to 10000 in session
  • [IOTDB-798] fix a set rowLimit and rowOffset bug
  • [IOTDB-800] Add a new config type for those parameters which could not be modified any more after the first start
  • [IOTDB-802] Improve "group by" query performance
  • [IOTDB-799] remove log visualizer tool from v0.10
  • fix license-binary
  • [IOTDB-805] Fix BufferUnderflowException when querying TsFile stored in HDFS
  • python session client ver-0.10.0
  • [IOTDB-808] fix bug in selfCheck() truncate
  • fix doc of MeasurementSchema in Tablet
  • [IOTDB-811] fix upgrading mlog many times when upgrading system.properties crashed
  • Improve IoTDB restart process
  • remove jol-core dependency which is introduced by hive-serde 2.8.4
  • remove org.json dependency because of license compatibility
  • [ISSUE-1551] fix set historical version when loading additional tsfile

Apache IoTDB (incubating) 0.10.0

New Features

  • IOTDB-217 A new GROUPBY syntax, e.g., select avg(s1) from root.sg.d1.s1 GROUP BY ([1, 50), 5ms)
  • IOTDB-220 Add hot-load configuration function
  • IOTDB-275 allow using user defined JAVA_HOME and allow blank space in the JAVA_HOME
  • IOTDB-287 Allow domain in JDBC URL
  • IOTDB-292 Add load external tsfile feature
  • IOTDB-297 Support "show flush task info"
  • IOTDB-298 Support new Last point query. e.g, select last * from root
  • IOTDB-305 Add value filter function while executing align by device
  • IOTDB-309 add Dockerfiles for 0.8.1, 0.9.0, and 0.9.1
  • IOTDB-313 Add RandomOnDiskUsableSpaceStrategy
  • IOTDB-323 Support insertRecords in session
  • IOTDB-337 Add timestamp precision properties for grafana
  • IOTDB-343 Add test method in session
  • IOTDB-396 Support new query clause: disable align, e.g., select * from root disable align
  • IOTDB-447 Support querying non-existing measurement and constant measurement
  • IOTDB-448 Add IN operation, e.g., where time in (1,2,3)
  • IOTDB-456 Support GroupByFill Query, e.g., select last_value(s1) from root.sg.d1 GROUP BY ([1, 10), 2ms) FILL(int32[previousUntilLast])
  • IOTDB-467 The CLI displays query results in a batch manner
  • IOTDB-497 Support Apache Flink Connector with IoTDB
  • IOTDB-558 add text support for grafana
  • IOTDB-560 Support Apache Flink connecter with TsFile
  • IOTDB-565 MQTT Protocol Support, disabled by default, open in iotdb-engine.properties
  • IOTDB-574 Specify configuration when start iotdb
  • IOTDB-588 Add tags and attributes management
  • IOTDB-607 add batch create timeseries in native interface
  • IOTDB-612 add limit&offset to show timeseries
  • IOTDB-615 Use TsDataType + Binary to replace String in insert plan
  • IOTDB-617 Support alter one time series's tag/attribute
  • IOTDB-630 Add a jdbc-like way to fetch data in session
  • IOTDB-640 Enable system admin sql (flush/merge) in JDBC or Other API
  • IOTDB-671 Add clear cache command
  • Support open and close time range in group by, e.g, [), (]
  • Online upgrade from 0.9.x
  • Support special characters in path: -/+&%$#@
  • IOTDB-446 Support path start with a digit, e.g., root.sg.12a
  • enable rpc compression in session pool
  • Make JDBC OSGi usable and added a feature file
  • add printing one resource file tool
  • Allow count timeseries group by level=x using default path
  • IOTDB-700 Add OpenID Connect based JWT Access as alternative to Username / Password
  • IOTDB-701 Set heap size by percentage of system total memory when starts
  • IOTDB-708 add config for inferring data type from string value
  • IOTDB-715 Support previous time range in previousuntillast
  • IOTDB-719 add avg_series_point_number_threshold in config
  • IOTDB-731 Continue write inside InsertPlan
  • IOTDB-734 Add Support for NaN in Double / Floats in SQL Syntax.
  • IOTDB-744 Support upsert alias

Incompatible changes

  • IOTDB-138 Move All metadata query to usual query
  • IOTDB-322 upgrade to thrift 0.12.0-0.13.0
  • IOTDB-325 Refactor Statistics in TsFile
  • IOTDB-419 Refactor the 'last' and 'first' aggregators to 'last_value' and 'first_value'
  • IOTDB-506 upgrade the rpc protocol to v2 to reject clients or servers that version < 0.10
  • IOTDB-587 TsFile is upgraded to version 2
  • IOTDB-593 add metaOffset in TsFileMetadata
  • IOTDB-597 Rename methods in Session: insertBatch to insertTablet, insertInBatch to insertRecords, insert to insertRecord
  • RPC is incompatible, you can not use client-v0.9 to connect with server-v0.10
  • TsFile format is incompatible, will be upgraded when starting 0.10
  • Refine exception code in native api

Miscellaneous changes

  • IOTDB-190 upgrade from antlr3 to antlr4
  • IOTDB-418 new query engine
  • IOTDB-429 return empty dataset instead of throw exception, e.g., show child paths root.*
  • IOTDB-445 Unify the keyword of "timestamp" and "time"
  • IOTDB-450 Add design documents
  • IOTDB-498 Support date format "2020-02-10"
  • IOTDB-503 Add checkTimeseriesExists in java native api
  • IOTDB-605 Add more levels of index in TsFileMetadata for handling too many series in one device
  • IOTDB-625 Change default level number: root is level 0
  • IOTDB-628 rename client to cli
  • IOTDB-621 Add Check isNull in Field for querying using session
  • IOTDB-632 Performance improve for PreviousFill/LinearFill
  • IOTDB-695 Accelerate the count timeseries query
  • IOTDB-707 Optimize TsFileResource memory usage
  • IOTDB-730 continue write in MQTT when some events are failed
  • IOTDB-729 shutdown uncessary threadpool
  • IOTDB-733 Enable setting for mqtt max length
  • IOTDB-732 Upgrade fastjson version to 1.2.70
  • Allow "count timeseries" without a prefix path
  • Add max backup log file number
  • add rpc compression api in client and session module
  • Continue writing the last unclosed file
  • Move the vulnera-checks section into the apache-release profile to accelerate compile
  • Add metaquery in python example
  • Set inferType of MQTT InsertPlan to true

Bug Fixes

  • IOTDB-125 Potential Concurrency bug while deleting and inserting happen together

  • IOTDB-185 fix start-client failed on WinOS if there is blank space in the file path; let start-server.bat suport jdk12,13 etc

  • IOTDB-304 Fix bug of incomplete HDFS URI

  • IOTDB-341 Fix data type bug in grafana

  • IOTDB-346 Fix a bug of renaming tsfile in loading function

  • IOTDB-370 fix a concurrent problem in parsing sql

  • IOTDB-376 fix metric to show executeQuery

  • IOTDB-392 fix export CSV

  • IOTDB-393 Fix unclear error message for no privilege users

  • IOTDB-401 Correct the calculation of a chunk if there is no data in the chunk, do not flush empty chunk

  • IOTDB-412 Paths are not correctly deduplicated

  • IOTDB-420 Avoid encoding task dying silently

  • IOTDB-425 fix can't change the root password.

  • IOTDB-459 Fix calmem tool bug

  • IOTDB-470fix IllegalArgumentException when there exists 0 byte TsFile

  • IOTDB-529 Relative times and NOW() operator cannot be used in Group By

  • IOTDB-531 fix issue when grafana visualize boolean data

  • IOTDB-546 Fix show child paths statement doesn't show quotation marks

  • IOTDB-643 Concurrent queries cause BufferUnderflowException when storage in HDFS

  • IOTDB-663 Fix query cache OOM while executing query

  • IOTDB-664 Win -e option

  • IOTDB-669 fix getting two columns bug while ”show devices“ in session

  • IOTDB-692 merge behaves incorrectly

  • IOTDB-712 Meet BufferUnderflowException and can not recover

  • IOTDB-718 Fix wrong time precision of NOW()

  • IOTDB-735 Fix Concurrent error for MNode when creating time series automatically

  • IOTDB-738 Fix measurements has blank

  • fix concurrent auto create schema conflict bug

  • fix meet incompatible file error in restart

  • Fix bugs of set core-site.xml and hdfs-site.xml paths in HDFS storage

  • fix execute flush command while inserting bug

  • Fix sync schema pos bug

  • Fix batch execution bug, the following sqls will all fail after one error sql

  • Fix recover endTime set bug

Apache IoTDB (incubating) 0.9.3

Bug Fixes

  • IOTDB-531 Fix that JDBC URL does not support domain issue
  • IOTDB-563 Fix pentaho cannot be downloaded because of spring.io address
  • IOTDB-608 Skip error Mlog
  • IOTDB-634 Fix merge caused errors for TsFile storage in HDFS
  • IOTDB-636 Fix Grafana connector does not use correct time unit

Miscellaneous changes

  • IOTDB-528 Modify grafana group by
  • IOTDB-635 Add workaround when doing Aggregation over boolean Series
  • Remove docs of Load External Tsfile
  • Add Grafana IoTDB Bridge Artifact to distribution in tools/grafana folder

Apache IoTDB (incubating) 0.9.2

Bug Fixes

  • IOTDB-553 Fix Return Empty ResultSet when queried series doesn't exist
  • IOTDB-575 add default jmx user and password; fix issues that jmx can't be accessed remotely
  • IOTDB-584 Fix InitializerError when recovering files on HDFS
  • Fix batch insert once an illegal sql occurs all the sqls after that will not succeed
  • Fix concurrent modification exception when iterator TsFileResourceList
  • Fix some HDFS config issues
  • Fix runtime exception not be catched and sync schema pos was nullpointer bug in DataTransferManager
  • Fix python rpc grammar mistakes
  • Fix upgrade ConcurrentModificationException

Miscellaneous changes

  • IOTDB-332 support Chinese characters in path
  • IOTDB-316 add AVG function to 4-SQL Reference.md and modify style
  • improve start-server.bat by using quotes to protect against empty entries
  • Add Chinese documents for chapter 4.2
  • change download-maven-plugin to 1.3.0
  • add session pool
  • add insertInBatch in Session
  • add insertInBatch to SessionPool
  • modify 0.9 docs to fit website
  • remove tsfile-format.properties
  • add bloom filter in iotdb-engien.properties
  • update server download doc
  • typos fix in Rel/0.9 docs
  • support 0.12.0 and 0.13.0 thrift

Apache IoTDB (incubating) 0.9.1

Bug Fixes

  • IOTDB-159 Fix NullPointerException in SeqTsFileRecoverTest and UnseqTsFileRecoverTest
  • IOTDB-317 Fix a bug that "flush + wrong aggregation query" causes the following queries to fail
  • IOTDB-324 Fix inaccurate statistics when writing in batch
  • IOTDB-327 Fix a groupBy-without-value-filter query bug caused by the wrong page skipping logic
  • IOTDB-331 Fix a groupBy query bug when axisOrigin-startTimeOfWindow is an integral multiple of interval
  • IOTDB-357 Fix NullPointerException in ActiveTimeSeriesCounter
  • IOTDB-359 Fix a wrong-data-type bug in TsFileSketchTool
  • IOTDB-360 Fix bug of a deadlock in CompressionRatio
  • IOTDB-363 Fix link errors in Development-Contributing.md and add Development-Document.md
  • IOTDB-392 Fix a bug in CSV export tool
  • Fix apache rat header format error in some files

Miscellaneous changes

  • IOTDB-321 Add definitions of time expression and LEVEL in related documents
  • Support pypi distribution for Python client

Apache IoTDB (incubating) 0.9.0

New Features

  • IOTDB-143 Compaction of data file
  • IOTDB-151 Support number format in timeseries path
  • IOTDB-158 Add metrics web service
  • IOTDB-173 Add batch write interface in session
  • IoTDB-174 Add interfaces for querying device or timeseries number
  • IOTDB-187 Enable to choose storage in local file system or HDFS
  • IOTDB-188 Delete storage group
  • IOTDB-193 Create schema automatically when inserting
  • IOTDB-198 Add sync module (Sync TsFiles between IoTDB instances)
  • IOTDB-199 Add a log visualization tool
  • IOTDB-203 Add "group by device" function for narrow table display
  • IOTDB-205 Support storage-group-level Time To Live (TTL)
  • IOTDB-208 Add Bloom filter in TsFile
  • IOTDB-223 Add a TsFile sketch tool
  • IoTDB-226 Hive-TsFile connector
  • IOTDB-239 Add interface for showing devices
  • IOTDB-241 Add query and non query interface in session
  • IOTDB-249 Enable lowercase in create_timeseries sql
  • IOTDB-253 Support time expression
  • IOTDB-259 Level query of path
  • IOTDB-282 Add "show version"
  • IOTDB-294 Online upgrade from 0.8.0 to 0.9.0
  • Spark-iotdb-connector
  • Support quoted measurement name
  • Generate cpp, go, and python thrift files under service-rpc
  • Display cache hit rate through jconsole
  • Support inserting data that time < 0
  • Add interface (Delete timeseries) in session
  • Add a tool to print tsfileResources (each device's start and end time)
  • Support watermark feature
  • Add micro and nano timestamp precision

Incompatible changes

  • RPC is incompatible, you can not use client-0.8.0 to connect with server-0.9.0 or use client-0.9.0 to connect with server-0.8.0.
  • Server is backward compatible, server-0.9.0 could run on data folder of 0.8.0. The data file will be upgraded background.
  • Change map key in TsDigest from String to enum data type

Miscellaneous changes

  • IOTDB-144 Meta data cache for query
  • IOTDB-153 Further limit fetchSize to speed up LIMIT&OFFSET query
  • IOTDB-160 External sort
  • IOTDB-161 Add ErrorCode of different response errors
  • IOTDB-180 Get rid of JSON format in "show timeseries"
  • IOTDB-192 Improvement for LRUCache
  • IOTDB-210 One else if branch will never be reached in the method optimize of ExpressionOptimizer
  • IOTDB-215 Update TsFile sketch tool and TsFile docs for v0.9.0
  • IOTDB-221 Add a python client example
  • IOTDB-233 keep metadata plan clear
  • IOTDB-251 Improve TSQueryDataSet structure in RPC
  • IOTDB-257 Makes the client stop fetch when dataSize equals maxPrintRowCount and change client fetchSize less than maxPrintRowCount
  • IOTDB-258 Add documents for Query History Visualization Tool and Shared Storage Architecture
  • IOTDB-265 Re-adjust the threshold size of memtable
  • IOTDB-267 Reduce IO operations in deserializing chunk header
  • IOTDB-273 Parallel recovery
  • IOTDB-276 Fix inconsistent ways of judging whether a Field is null
  • IOTDB-285 Duplicate fields in EngineDataSetWithoutValueFilter.java
  • IOTDB-287 Restrict users to only use domain names and IP addresses.
  • IOTDB-293 Variable naming convention
  • IOTDB-295 Refactor db.exception
  • Reconstruct Antlr3 grammar to improve performance
  • Tooling for release
  • Modified Decoder and SequenceReader to support old version of TsFile
  • Remove jdk constrain of jdk8 and 11
  • Modify print function in AbstractClient
  • Avoid second execution of parseSQLToPhysicalPlan in executeStatement

Known Issues

  • IOTDB-20 Need to support UPDATE

Bug Fixes

  • IOTDB-168&169 Fix a bug in export-csv tool and fix compatibility of timestamp formats in exportCsv, client display and sql
  • IOTDB-174 Fix querying timeseries interface cannot make a query by the specified path prefix
  • IOTDB-195 Using String.getBytes(utf-9).length to replace string.length() in ChunkGroupMetadata for supporting Chinese
  • IOTDB-211 Use "%IOTDB_HOME%\lib*" to refers to all .jar files in the directory in start-server.bat
  • IOTDB-240 Fix unknown time series in where clause
  • IOTDB-244 Fix bug when querying with duplicated columns
  • IOTDB-252 Add/fix shell and bat for TsFileSketchTool/TsFileResourcePrinter
  • IOTDB-266 NullPoint exception when reading not existed devices using ReadOnlyTsFile
  • IOTDB-264 Restart failure due to WAL replay error
  • IOTDB-290 Bug about threadlocal field in TSServiceImpl.java
  • IOTDB-291 Statement close operation may cause the whole connection's resource to be released
  • IOTDB-296 Fix error when skip page data in sequence reader
  • IOTDB-301 Bug Fix: executing "count nodes root" in client gets "Msg:3"
  • Fix Dynamic Config when Creating Existing SG or Time-series
  • Fix start-walchecker scripts for letting user define the wal folder
  • Fix start script to set JAVA_HOME

Apache IoTDB (incubating) 0.8.2

This is a bug-fix version of 0.8.1

  • IOTDB-264 lack checking datatype before writing WAL
  • IOTDB-317 Fix "flush + wrong aggregation" causes failed query in v0.8.x
  • NOTICE and LICENSE file update

Apache IoTDB (incubating) 0.8.1

This is a bug-fix version of 0.8.0

  • IOTDB-172 Bug in updating startTime and endTime in TsFileResource
  • IOTDB-195 Bug about 'serializedSize' in ChunkGroupMetaData.java (for Chinese string)
  • IOTDB-202 fix tsfile example data type
  • IOTDB-242 fix mvn integration-test failed because the files in the target folder changes
  • Abnormal publishing of sequence and unsequence data folders in DirectoryManager
  • Fix a bug in TimeRange's intersects function

Apache IoTDB (incubating) 0.8.0

This is the first official release of Apache IoTDB after joining the Incubator.

New Features

  • IOTDB-1 Add Aggregation query
  • IOTDB-4 Asynchronously force sync WAL periodically
  • IOTDB-5 Support data deletion
  • IOTDB-11 Support start script for jdk 11 on Windows OS
  • IOTDB-18 Improve startup script compatible for jdk11
  • IOTDB-36 [TsFile] Enable recover data from a incomplete TsFile and continue to write
  • IOTDB-37 Add WAL check tool script
  • IOTDB-51 Update post-back module to synchronization module
  • IOTDB-59 Support GroupBy query
  • IOTDB-60 Support Fill function when query
  • IOTDB-73 Add REGULAR encoding method for data with fixed frequency
  • IOTDB-80 Support custom export file name
  • IOTDB-81 Update travis for supporting JDK11 on Windows
  • IOTDB-83 Add process bar for import script and show how many rows have been exported
  • IOTDB-91 Improve tsfile-spark-connector to support spark-2.4.3
  • IOTDB-93 IoTDB Calcite integration
  • IOTDB-109 Support appending data at the end of a completed TsFile
  • IOTDB-122 Add prepared statement in JDBC
  • IOTDB-123 Add documents in Chinese
  • IOTDB-130 Dynamic parameters adapter
  • IOTDB-134 Add default parameter for client starting script
  • Add read-only mode of IoTDB
  • New storage engine with asynchronously flush and close data file
  • Adding english documents
  • Supporting travis + window + jdk8
  • Add skipping all UTs: maven integration-test -DskipUTS=true
  • Enable users define the location of their thrift compiler
  • Add example module
  • Add a log appender: put info, warn, error log into one file and disable log_info by default
  • Recover when resource file does not exist while tsfile is complete

Incompatible changes

If you use the previous unofficial version 0.7.0. It is incompatible with 0.8.0.

Miscellaneous changes

  • IOTDB-21 Add ChunkGroup offset information in ChunkGroupMetaData
  • IOTDB-25 Add some introduction for JMX MBean Monitor in user guide
  • IOTDB-29 Multiple Exceptions when reading empty measurements from TsFileSequenceReader
  • IOTDB-39 Add auto repair functionality for RestorableTsFileIOWriter
  • IOTDB-45 Update the license in IoTDB
  • IOTDB-56 Faster getSortedTimeValuePairList() of Memtable
  • IOTDB-62 Change log level from error to debug in SQL parser
  • IoTDB-63 Use TsFileInput instead of FileChannel as the input parameter of some functions
  • IOTDB-76 Reformat MManager.getMetadataInString() in JSON format
  • IOTDB-78 Make unsequence file format more similar with TsFile
  • IOTDB-95 Keep stack trace when logging or throwing an exception
  • IOTDB-117 Add sync documents
  • Modify ASF header for each file and add related maven plugin
  • Add IoTDB env script test
  • Add sync function for jdbc server to close
  • Add cache directories for download jars and sonar plugin of maven in travis
  • Add partition start and end offset constraints when loading ChunkGroupMetaData
  • Check when creating Storage group
  • Try to release memory asap in ReadOnlyMemChunk
  • Add more physical plan serializer
  • Move all generated tsfiles for test into the target folder
  • Make TsFileWriter as AutoClosable
  • Print apache-rat violation result on console
  • Update multi dir avoid disk is full
  • Simplify Path construction
  • Separate documents into different chapter folders
  • Suppress mvn log in travis
  • Add mvn -B in travis

Known Issues

  • IOTDB-20 Need to support UPDATE
  • IOTDB-124 Lost timeseries info after restart IoTDB
  • IOTDB-125 [potential] a concurrency conflict may occur when a delete command and insertion command appears concurrently
  • IOTDB-126 IoTDB will not be closed immediately after run 'stop-server.sh' script
  • IOTDB-127 Chinese version documents problems

Bug Fixes

  • IOTDB-2 Maven Test failed before run mvn package -Dmaven.test.skip=true
  • IOTDB-7 OpenFileNumUtilTest failed
  • IOTDB-15 Fail to install IoTDB on Ubuntu 14.04
  • IOTDB-16 Invalid link on https://iotdb.apache.org/#/Documents/Quick Start
  • IOTDB-17 Need to update chapter Start of https://iotdb.apache.org/#/Documents/Quick Start
  • IOTDB-18 IoTDB startup script does not work on openjdk11
  • IOTDB-19 Fail to start start-server.sh script on Ubuntu 14.04/Ubuntu 16.04
  • IOTDB-22 BUG in TsFileSequenceReader when reading tsfile
  • IOTDB-24 DELETION error after restart a server
  • IOTDB-26 Return error when quit client
  • IOTDB-27 Delete error message
  • IOTDB-30 Flush timeseries cause select to returns "Msg:null"
  • IOTDB-31 Cannot set float number precision
  • IOTDB-34 Invalid message for show storage group
  • IOTDB-44 Error message in server log when select timeseries
  • IOTDB-49 Authorizer module outputs too many debug log info
  • IOTDB-50 DataSetWithoutTimeGenerator's initHeap behaves wrongly
  • IOTDB-52 Cli doesn't support aggregate
  • IOTDB-54 Predicates doesn't take effect
  • IOTDB-67 ValueDecoder reading new page bug
  • IOTDB-70 Disconnect from server when logging in fails
  • IOTDB-71 Improve readPositionInfo
  • IOTDB-74 THe damaged log will be skipped if it is the only log
  • IOTDB-79 Long term test failed because of the version control of deletion function
  • IOTDB-81 Fix Windows OS environment for Travis-CI
  • IOTDB-82 File not closed in PageHeaderTest and cause UT on Windows fails
  • IOTDB-84 Out-of-memory bug
  • IOTDB-94 IoTDB failed to start client since the required jars are not in the right folder
  • IOTDB-96 The JDBC interface throws an exception when executing the SQL statement "list user"
  • IOTDB-99 List privileges User on cannot be used properly
  • IOTDB-100 Return error message while executing sum aggregation query
  • IOTDB-103 Does not give a hint when encountering unsupported data types
  • IOTDB-104 MManager is incorrectly recovered when system reboots
  • IOTDB-108 Mistakes in documents
  • IOTDB-110 Cli inserts data normally even if there is no space left on the disk
  • IOTDB-118 When the disk space is full, the storage group is created successfully
  • IOTDB-121 A bug of query on value columns
  • IOTDB-128 Probably a bug in iotdb official website
  • IOTDB-129 A bug in restoring incomplete tsfile when system restart
  • IOTDB-131 IoTDB-Grafana-Connector module error when getting the timeseries list from Grafana
  • IOTDB-133 Some content is mistaken for links
  • System memory check failure in iotdb-env.sh
  • Time zone bug in different region
  • DateTimeUtilsTest UT bug
  • Problem discovered by Sonar
  • Openjdk11 + linux11 does not work on travis
  • Start JDBC service too slowly
  • JDBC cannot be closed
  • Close bug in sync thread
  • Bug in MManager to get all file names of a path
  • Version files of different storage groups are placed into the same place
  • Import/export csv script bug
  • Log level and stack print in test
  • Bug in TsFile-Spark-Connector
  • A doc bug of QuickStart.md