Skip to content

v0.5.1
Compare
Choose a tag to compare
@JoshRosen JoshRosen released this 05 Oct 23:17
· 92 commits to master since this release
v0.5.1
f4a636c

spark-redshift 0.5.1 is a maintenance release which contains several bugfixes and usability improvements:

  • Improved JDBC quoting and escaping:
    • Column names are now properly quoted when saving tables to Redshift, allowing reserved words or names containing special characters to be used as column names (#80 / #85).
    • Table names that are qualified with schemas (e.g. myschema.mytable) or which contain special characters (such as spaces) are now supported (#97 / #102).
  • Improved dependency handling:
    • spark-redshift no longer has a binary dependency on the hadoop-aws artifact, which caused problems for EMR users (#92 / #94).
    • When using the Redshift JDBC driver, both the JDBC 4.0 and 4.1 versions of the driver can now be used without having to change the default jdbcdriver setting; the proper configuration will be automatically chosen depending on which version of the JDBC driver can be loaded (#83 / #90).
  • Misc. bugfixes:
    • Fix a bug which prevented tables with empty partitions from being saved to Redshift (#96 / #102).
    • Fix spurious exceptions when checking the S3 bucket lifecycle configuration when tempdir points to the root of the bucket (#91 / #95).
    • Fixed a bug in Utils.joinURLs which caused problems for Windows users (#93).
Assets 2
Loading