Skip to content
/ OAP Public
forked from LinhongLiu/OAP

Optimized Analytics Package for Spark* Platform

License

Notifications You must be signed in to change notification settings

expxiaoli/OAP

 
 

Repository files navigation

Optimized Analytics Package for Spark* Platform (OAP)

Soft Reminder

Maintenance releases for OAP 0.8.x and 1.0.x will continue host here.

OAP 1.1+ development and release have migrated to https://github.com/oap-project

LEGAL

* LEGAL NOTICE: Your use of this software and any required dependent software (the "Software Package") is subject to the terms and conditions of the software license agreements for the Software Package, which may also include notices, disclaimers, or license terms for third party or open source software included in or with the Software Package, and your use indicates your acceptance of all such terms. Please refer to the "TPP.txt" or other similarly-named text file included with the Software Package for additional details.
* Optimized Analytics Package for Spark* Platform is under Apache 2.0 (https://www.apache.org/licenses/LICENSE-2.0).

OAP is a project to optimize Spark by providing optimized implementation of packages for various aspects including cache, shuffle, native SQL engine, Mllib and so on. In this version, OAP contains the optimized implementations of SQL Index and Data Source Cache supporting DRAM and PMem, RDD Cache PMem Extension, Shuffle Remote PMem Extension, Remote Shuffle, Intel MLlib, Unified Arrow Data Source and Native SQL Engine.

Installation Guide

Please follow the link below for the guide to compile and install OAP to your system.

User Guide

Please refer to the corresponding documents below for the introductions on how to use the features.

Developer Guide

Please follow the link below for the guide for developers.

*Other names and brands may be claimed as the property of others.

About

Optimized Analytics Package for Spark* Platform

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Scala 65.0%
  • C++ 24.2%
  • Java 7.8%
  • C 1.2%
  • Shell 0.8%
  • JavaScript 0.3%
  • Other 0.7%