Skip to content

Releases: apache/opendal

v0.29.0

01 Mar 13:02
@Xuanwo Xuanwo
v0.29.0
This tag was signed with the committer’s verified signature. The key has expired and has been revoked.
Xuanwo Xuanwo
GPG key ID: 04BB8A6A484EF6E0
Expired Revoked
Learn about vigilant mode.
8f62f9b
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.29.0

Upgrade to v0.29

In v0.29, we introduced [Object Writer][crate::docs::rfcs::rfc_1420_object_writer] to replace existing Multipart related APIs.

Users can now append multiparts bytes into object via:

let mut w = o.writer().await?;
w.write(bs1).await?;
w.write(bs2).await?;
w.close()

Along with this change, we cleaned up a lot of internal structs and traits. Users who used to depend on opendal::raw::io::{input,output} should use opendal::raw::oio instead.

Also, decompress related feature also removed. Users can use async-compression with ObjectReader directly.

What's Changed

New Contributors

Full Changelog: v0.28.0...v0.29.0

Contributors

Xuanwo, tisonkun, and 2 other contributors
Assets 2
Loading
2 Join discussion

v0.28.0

22 Feb 06:38
@Xuanwo Xuanwo
v0.28.0
This tag was signed with the committer’s verified signature. The key has expired and has been revoked.
Xuanwo Xuanwo
GPG key ID: 04BB8A6A484EF6E0
Expired Revoked
Learn about vigilant mode.
f824e98
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.28.0

Upgrade to v0.28

In v0.28, we introduced Query Based Metadata. Users can query cached metadata with ObjectMetakey to make sure that OpenDAL always makes the best decision.

- pub async fn metadata(&self) -> Result<ObjectMetadata>;
+ pub async fn metadata(
+        &self,
+        flags: impl Into<FlagSet<ObjectMetakey>>,
+    ) -> Result<Arc<ObjectMetadata>>;

Please visit Object::metadata()'s example for more details.

What's Changed

  • feat: add dashmap support by @PsiACE in #1390
  • RFC-1391: Object Metadataer by @Xuanwo in #1391
  • refactor: Implement query based object metadata cache by @Xuanwo in #1395
  • refactor: Store complete inside bits and add more examples by @Xuanwo in #1397
  • RFC-1398: Query Based Metadata by @Xuanwo in #1398
  • refactor: Trigger panic if users try to visit not fetched metadata by @Xuanwo in #1399
  • refactor: Polish the implement of Query Based Metadata Cache by @Xuanwo in #1400
  • Bump version to 0.28 by @Xuanwo in #1401

Full Changelog: v0.27.2...v0.28.0

Contributors

Xuanwo and PsiACE
Assets 2
Loading
0 Join discussion

v0.27.2

20 Feb 08:19
@Xuanwo Xuanwo
v0.27.2
This tag was signed with the committer’s verified signature. The key has expired and has been revoked.
Xuanwo Xuanwo
GPG key ID: 04BB8A6A484EF6E0
Expired Revoked
Learn about vigilant mode.
adafc83
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.27.2

What's Changed

New Contributors

Full Changelog: v0.27.1...v0.27.2

Contributors

fatelei, imWildCat, and 4 other contributors
Assets 2
Loading
0 Join discussion

v0.27.1

13 Feb 08:08
@Xuanwo Xuanwo
v0.27.1
This tag was signed with the committer’s verified signature. The key has expired and has been revoked.
Xuanwo Xuanwo
GPG key ID: 04BB8A6A484EF6E0
Expired Revoked
Learn about vigilant mode.
c913415
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.27.1

What's Changed

New Contributors

Full Changelog: v0.27.0...v0.27.1

Contributors

Xuanwo, dependabot, and 2 other contributors
Assets 2
Loading
0 Join discussion

v0.27.0

11 Feb 07:23
@Xuanwo Xuanwo
v0.27.0
This tag was signed with the committer’s verified signature. The key has expired and has been revoked.
Xuanwo Xuanwo
GPG key ID: 04BB8A6A484EF6E0
Expired Revoked
Learn about vigilant mode.
43541c6
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.27.0

Upgrade to v0.27

In v0.27, we refactored our list related logic and added scan support. So make Pager and BlockingPager associated types in Accessor too!

pub trait Accessor: Send + Sync + Debug + Unpin + 'static {
    type Reader: output::Read;
    type BlockingReader: output::BlockingRead;
+    type Pager: output::Page;
+    type BlockingPager: output::BlockingPage;
}

User defined layers

Due to this change, all layers implementation should be changed. If there is not changed over pager, they can by changed like the following:

impl<A: Accessor> LayeredAccessor for MyAccessor<A> {
    type Inner = A;
    type Reader = MyReader<A::Reader>;
    type BlockingReader = MyReader<A::BlockingReader>;
+    type Pager = A::Pager;
+    type BlockingPager = A::BlockingPager;

+    async fn list(&self, path: &str, args: OpList) -> Result<(RpList, Self::Pager)> {
+        self.inner.list(path, args).await
+    }

+    async fn scan(&self, path: &str, args: OpScan) -> Result<(RpScan, Self::Pager)> {
+        self.inner.scan(path, args).await
+    }

+    fn blocking_list(&self, path: &str, args: OpList) -> Result<(RpList, Self::BlockingPager)> {
+        self.inner.blocking_list(path, args)
+    }

+    fn blocking_scan(&self, path: &str, args: OpScan) -> Result<(RpScan, Self::BlockingPager)> {
+        self.inner.blocking_scan(path, args)
+    }
}

Usage of ops

To reduce the understanding overhead, we move all OpXxx into opendal::ops now. User may need to change:

- use opendal::OpWrite;
+ use opendal::ops::OpWrite;

Usage of RetryLayer

backon is the implementation detail of our RetryLayer, so we hide it from our public API. Users of RetryLayer need to change the code like:

- RetryLayer::new(backon::ExponentialBackoff::default())
+ RetryLayer::new()

What's Changed

New Contributors

Full Changelog: v0.26.2...v0.27.0

Contributors

Xuanwo, PsiACE, and 4 other contributors
Assets 2
Loading
0 Join discussion

v0.26.2

07 Feb 06:51
@Xuanwo Xuanwo
v0.26.2
This tag was signed with the committer’s verified signature. The key has expired and has been revoked.
Xuanwo Xuanwo
GPG key ID: 04BB8A6A484EF6E0
Expired Revoked
Learn about vigilant mode.
5d5c651
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.26.2

What's Changed

New Contributors

Full Changelog: v0.26.1...v0.26.2

Contributors

baszalmstra, Xuanwo, and 2 other contributors
Assets 2
Loading
0 Join discussion

v0.26.1

05 Feb 10:18
@Xuanwo Xuanwo
v0.26.1
This tag was signed with the committer’s verified signature. The key has expired and has been revoked.
Xuanwo Xuanwo
GPG key ID: 04BB8A6A484EF6E0
Expired Revoked
Learn about vigilant mode.
48f49bc
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.26.1

v0.26.1 - 2023-02-05

Changed

  • refactor: Remove not used layer subdir (#1280)

Docs

  • docs: Add v0.26 upgrade guide (#1276)
  • docs: Add feature sets in services (#1277)
  • docs: Migrate all docs in rustdoc instead (#1281)
  • docs: Fix index page not redirected (#1282)
Assets 2
Loading
0 Join discussion

v0.26.0

04 Feb 10:06
@Xuanwo Xuanwo
v0.26.0
This tag was signed with the committer’s verified signature. The key has expired and has been revoked.
Xuanwo Xuanwo
GPG key ID: 04BB8A6A484EF6E0
Expired Revoked
Learn about vigilant mode.
50c2608
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.26.0

Upgrade to v0.26

In v0.26 we have replaced all internal dynamic dispatch usage with static dispatch. With this change, we can ensure that all operations performed inside OpenDAL are zero cost.

Due to this change, we have to refactor the logic of Operator's init logic. In v0.26, we added opendal::Builder trait and opendal::OperatorBuilder. For the first glance, the only change to existing code will be like:

- let op = Operator::new(builder.build()?);
+ let op = Operator::new(builder.build()?).finish();

By adding a finish() call, we will erase all generic types so that Operator can still be easily to used everywhere as before.

Accessor

In v0.26, Accessor has been changed into trait with associated types.

All services need to decalare the types returned as Reader or BlockingReader:

pub trait Accessor: Send + Sync + Debug + Unpin + 'static {
    type Reader: output::Read;
    type BlockingReader: output::BlockingRead;
}

If your service doesn't support read or blocking_read, we can use () to represent an dummy reader:

impl Accessor for MyDummyAccessor {
    type Reader = ();
    type BlockingReader = ();
}

Layer

As described before, OpenDAL prefer to use static dispatch. Layers are required to implement the new Layer and LayeredAccessor trait:

pub trait Layer<A: Accessor> {
    type LayeredAccessor: Accessor;

    fn layer(&self, inner: A) -> Self::LayeredAccessor;
}

#[async_trait]
pub trait LayeredAccessor: Send + Sync + Debug + Unpin + 'static {
    type Inner: Accessor;
    type Reader: output::Read;
    type BlockingReader: output::BlockingRead;
}

LayeredAccessor is a wrapper of Accessor with the typed Innder. All methods that not implemented will be forward to inner instead.

Builder

Since v0.26, we implement opendal::Builder for all services, and services' mod will not be exported.

- use opendal::services::s3::Builder;
+ use opendal::services::S3;

Conclusion

Sorry again for the big changes in this release. It's a big step for OpenDAL to work in more critical systems.

What's Changed

New Contributors

Full Changelog: v0.25.2...v0.26.0

Contributors

Kilerd, Xuanwo, and 2 other contributors
Assets 2
Loading
0 Join discussion

v0.25.2

30 Jan 05:53
@Xuanwo Xuanwo
v0.25.2
This tag was signed with the committer’s verified signature. The key has expired and has been revoked.
Xuanwo Xuanwo
GPG key ID: 04BB8A6A484EF6E0
Expired Revoked
Learn about vigilant mode.
c1f2599
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.25.2

What's Changed

New Contributors

Full Changelog: v0.25.1...v0.25.2

Contributors

flaneur2020, Xuanwo, and 3 other contributors
Assets 2
Loading
0 Join discussion

v0.25.1

27 Jan 08:13
@Xuanwo Xuanwo
v0.25.1
This tag was signed with the committer’s verified signature. The key has expired and has been revoked.
Xuanwo Xuanwo
GPG key ID: 04BB8A6A484EF6E0
Expired Revoked
Learn about vigilant mode.
941c525
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.25.1

What's Changed

  • ci: Setup benchmark workflow by @Xuanwo in #1200
  • refactor: Remove observe read/write by @Xuanwo in #1202
  • feat: Let's try play with python by @Xuanwo in #1205
  • feat: Let's try play with Node.js by @Xuanwo in #1206
  • chore: Add license header for nodejs by @Xuanwo in #1207
  • fix: Retry for read and write should at ObjectReader level by @Xuanwo in #1211
  • feat: Allow retry sending read request by @Xuanwo in #1212
  • chore(deps): bump ibnesayeed/setup-ipfs from cacf727ab8eae418dc4a2534c2c2c19343021c7c to b9b9f7d73db5f77d462225bb37dbd51153351dd9 by @dependabot in #1217
  • refactor: Remove not used unwind safe feature by @Xuanwo in #1218
  • docs: Polish README by @Xuanwo in #1220
  • ci: Make sure opendal is buildable on windows by @Xuanwo in #1221
  • chore: Remove not needed files by @Xuanwo in #1224
  • ci: Remove not needed audit checks by @Xuanwo in #1226
  • cleanup: Move oli and oay into binaries by @Xuanwo in #1227
  • cleanup: Move testdata into tests/data by @Xuanwo in #1228
  • refactor(layers/metrics): Defer initiation of error counters by @Xuanwo in #1232
  • Bump to version 0.25.1 by @Xuanwo in #1233

Full Changelog: v0.25.0...v0.25.1

Contributors

Xuanwo and dependabot
Assets 2
Loading
0 Join discussion