Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jetpack 5.1.2 Patch 2 #7217

Draft
wants to merge 3,019 commits into
base: r23.06
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3019 commits
Select commit Hold shift + click to select a range
98c400a
Document JIT graph optimizations for TF models (#5022)
tanmayv25 Nov 1, 2022
40885e1
Fix L0_copyrights test (#5029)
tanmayv25 Nov 2, 2022
03e67df
Add checks for TRT uint8 support (#5006)
kthui Nov 3, 2022
35bdad5
Enable request rate manager test for C-API (#5030)
Tabrizian Nov 3, 2022
7fb0706
Update README and versions for 22.10 branch
mc-nv Oct 7, 2022
e0c222a
Change compile flag version 'c++14' -> 'c++17'
mc-nv Oct 7, 2022
7c9fc50
Enable SERVER_LD_PRELOAD in tests
mc-nv Oct 8, 2022
213b2c5
Change ONNXRUNTIME version to 1.13.1 (#5004)
mc-nv Oct 21, 2022
55b17e1
Update README for 22.10 release
mc-nv Oct 25, 2022
2b26225
updated stable diffusion example (#5028)
tanayvarshney Nov 4, 2022
e0e3606
Add tolerance to cpu metrics test (#5005)
rmccorm4 Nov 4, 2022
5c75057
Add test for TRT data dependent shape output. Add generation script f…
GuanLuo Nov 7, 2022
2206813
Add concurrent loading speedup test (#5032)
kthui Nov 7, 2022
dbfa5d7
Add GACs doc (#5048)
kthui Nov 8, 2022
66e49d8
Update 'main' to track development for 2.29.0 / r22.12
mc-nv Nov 9, 2022
d202690
Update expected error message based on TRT backend changes (#5057)
GuanLuo Nov 9, 2022
60d5ac6
Revert "Using alternative managed symbolic links for library paths (…
mc-nv Nov 10, 2022
8c4987a
Update TRITON_VERSION (#5066)
kthui Nov 10, 2022
83b07c6
Add test for older OS modification time (#5056)
kthui Nov 14, 2022
e84c5ba
updated stable diffusion example (#5083)
tanayvarshney Nov 17, 2022
c2a3722
Update Windows dockerfile (#5085)
krishung5 Nov 22, 2022
557f72f
Update Go Test (#5038)
dyastremsky Nov 23, 2022
7c22d25
Remove LD_PRELOAD from L0_infer/L0_sequence_batcher tests (#5047)
Tabrizian Nov 23, 2022
57acc79
Update README and versions for 22.11 branch
mc-nv Oct 31, 2022
edd4404
Windows Dockerfile update
mc-nv Nov 18, 2022
0702a95
Set range to mlflow package version
mc-nv Nov 21, 2022
f4b7ead
Upgrade PyTorch version in L0_backend_python/io (#5111)
Tabrizian Nov 28, 2022
a2ec7f8
Updated example to fix deprication issues. (#5117)
tanayvarshney Nov 29, 2022
b384a58
Update build.md (#5093)
alexanderkomarovincode3 Nov 30, 2022
576d2bc
Set LD_PRELOAD and TCMALLOC_RELEASE_RATE inside container (#5118)
krishung5 Dec 1, 2022
ed286f2
Fix file name in windows dockerfile (#5122)
krishung5 Dec 2, 2022
df47030
Revert tcmalloc changes in testing (#5135)
krishung5 Dec 5, 2022
9278e7c
Add LD_PRELOAD for sequence batcher/infer tests (#5125)
Tabrizian Dec 5, 2022
b4f5790
Upgrade Pytorch version installed in tests (#5140)
GuanLuo Dec 6, 2022
00d4296
Register TensorFlow Plugins at Runtime (#4944)
dyastremsky Dec 6, 2022
1ad1b85
Re-enable nvfuser test (#5142)
rmccorm4 Dec 7, 2022
8ba1b73
Add Ensemble support in SageMaker MME, improve 507 on SM Invoke OOM a…
nikhil-sk Dec 7, 2022
c695824
Add mismatch key vs name gpu io test (#5143)
kthui Dec 8, 2022
5546b03
Update documentation for LD_PRELOAD and tcmalloc (#5161)
krishung5 Dec 12, 2022
220beff
Add testing for variable GPU outputs in Python BE (#5166)
Tabrizian Dec 14, 2022
f7a071d
Add extension policy documentation limitation (#5169)
jbkyang-nvi Dec 15, 2022
87848cf
Revert "Add concurrent loading speedup test (#5032)" (#5179)
nv-kmcgill53 Dec 16, 2022
5d8003c
Add aws session token test (#5176)
kthui Dec 16, 2022
bc9777e
Fix np.object_ deprecations (#5184)
Tabrizian Dec 20, 2022
7183aed
Update NGC versions post-22.12 release (#5190)
mc-nv Dec 21, 2022
b915cb5
Add skip-pull flag to allow local build (#5186)
jbkyang-nvi Dec 21, 2022
db7e0c0
Seting version limit for 'numpy'. Enable debug for generation scripts…
mc-nv Dec 27, 2022
5ac4637
Document systems where shared memory supported (#5203)
dyastremsky Dec 28, 2022
25bcdee
Update copyright year (#5213)
cliffwoolley Jan 4, 2023
77ff43f
Improve trace docs (#5218)
Tabrizian Jan 5, 2023
f1e1e0b
Use ip for minio server address (#5219)
kthui Jan 5, 2023
9eb498b
Allow User-Defined Batching Strategies (#5177)
dyastremsky Jan 9, 2023
7efc1aa
increase PA test stability threshold to 100 since no test is testing …
matthewkotila Jan 9, 2023
b1c88a1
update tag to version tag instead of head of master (#5228)
jbkyang-nvi Jan 9, 2023
e763540
Fix checking of return code from memgrowth tests (#5250)
rmccorm4 Jan 14, 2023
102062f
new instruction for GKE marketplace app (#5264)
mengdong Jan 20, 2023
ab710db
Implement GRPC health check protocol (#5267)
dyastremsky Jan 23, 2023
fa9749a
Prevent potential hang in L0_infer running on CPU-only container
jbkyang-nvi Jan 25, 2023
020cab2
Remove unused variable (#5288)
dyastremsky Jan 30, 2023
3beb40b
Add PROT_READ to shared memory maps (#5289)
Tabrizian Feb 1, 2023
bdbe884
Update README and versions for 23.01 branch
mc-nv Jan 5, 2023
5d8b630
Updating libs location on CUDA update
mc-nv Jan 5, 2023
32e9fb7
Using cuda11.8 container for ORT build
tanmayv25 Jan 11, 2023
8f7aa75
Fix PyTorch CPU-only build (#5262)
Tabrizian Jan 19, 2023
e7ed9b5
Fixing typo (#5265)
mc-nv Jan 19, 2023
cd86fc4
Fix L0_memory_growth busyop test
Tabrizian Jan 20, 2023
8bcb8d1
Update main to track development for 2.31.0 / r23.02
mc-nv Feb 1, 2023
168df21
Remove util pycache (#5302)
dyastremsky Feb 2, 2023
2678a39
Revert 3beb40b06faa..8bcb8d17e5e
Tabrizian Feb 3, 2023
c2c08e5
Add PA request-intervals test (#5303)
tgerdesnv Feb 3, 2023
f90a91e
Update README.md versions
mc-nv Feb 3, 2023
93e2454
Refactor L0_tf_gpu_io to remove perf_client dependency (#5282)
dyastremsky Feb 3, 2023
b4cdd7d
Update README and versions for 23.01 branch
mc-nv Jan 5, 2023
15cafcc
Updating libs location on CUDA update
mc-nv Jan 5, 2023
fcb3e7c
Using cuda11.8 container for ORT build
tanmayv25 Jan 11, 2023
5b8ab59
Fix PyTorch CPU-only build (#5262)
Tabrizian Jan 19, 2023
59fa8eb
Fixing typo (#5265)
mc-nv Jan 19, 2023
bf68f01
Fix L0_memory_growth busyop test
Tabrizian Jan 20, 2023
783f1fd
Update main to track development for 2.31.0 / r23.02
mc-nv Feb 1, 2023
ea112b3
Add gdb backtrace and core dump to qa tests when server fails to star…
rmccorm4 Feb 4, 2023
b0f3db2
Update variable reference name
mc-nv Feb 4, 2023
7f32d88
Improvements to SM server and entrypoint (#5298)
nikhil-sk Feb 7, 2023
e622158
Add gdb to final stage of multi-stage qa container build (#5329)
rmccorm4 Feb 7, 2023
6be4e28
Improve fastertransformer build in build.py (#5281)
jbkyang-nvi Feb 7, 2023
42b1445
Allow gdb commands to fial if process doesn't exist (#5336)
rmccorm4 Feb 8, 2023
45dfb4d
Add libtorch data type test (#5330)
kthui Feb 8, 2023
131173f
Add testing for BLS decoupled support (#5245)
krishung5 Feb 11, 2023
c0c817f
Add documentation for time windows and count windows measurement mode…
matthewkotila Feb 13, 2023
b698ba9
Add testing for multi-tag, multi-IO TensorFlow models (#5344)
dyastremsky Feb 14, 2023
32aaf55
Clarify how GCS client obtain credentials (#5355)
kthui Feb 16, 2023
643c718
Updating model control stress test to add python backend (#5363)
oandreeva-nv Feb 16, 2023
d7780fd
Fix L0_backend_tutorial intermittent due to request ordering (#4882)
GuanLuo Feb 17, 2023
235683c
Expose option to enable model namespacing. Add test (#5362)
GuanLuo Feb 21, 2023
8b0e0d5
Relocate perf analyzer documentation (#5380)
matthewkotila Feb 22, 2023
92e9b9e
Add GitHub Discussions to README (#5399)
dyastremsky Feb 23, 2023
b6c0c18
Include the request id in the trace (#5406)
Tabrizian Feb 24, 2023
4c7ffe9
Update docs/build tools for TRITONCACHE API (#5409)
rmccorm4 Feb 24, 2023
302b033
added tutorials repository (#5424)
tanayvarshney Feb 27, 2023
cfd237b
Add --build-type exception for FIL backend (#5430)
rmccorm4 Mar 1, 2023
b987870
Update README and versions for 23.02 branch
mc-nv Feb 6, 2023
72b4571
Revert "Using cuda11.8 container for ORT build" (#5367)
GuanLuo Feb 16, 2023
28901a0
Changing 'aarch64' configuration for model generation (#5375)
mc-nv Feb 24, 2023
98ab3c9
Update User Guide for r23.02 (#5427)
dzier Feb 27, 2023
8d8214c
Update development versions post-23.02 release
mc-nv Feb 28, 2023
cc51ec2
GRPC endpoint clean up. Add missing protocol in doc (#5428)
GuanLuo Mar 1, 2023
56cad1e
Improve GDB usage in CI (#5429)
rmccorm4 Mar 1, 2023
99ad0cb
Remove redis mentions until finished (#5457)
rmccorm4 Mar 7, 2023
6fb8c83
Add timed wait during UNLOAD while the model becomes UNAVAILABLE in S…
nikhil-sk Mar 7, 2023
f304992
Changing reference to test plugin location (#5456)
mc-nv Mar 7, 2023
10392e7
Fix invalid use of info after deletion (#5462)
rmccorm4 Mar 7, 2023
7287202
Modify L0_backend_python bls test for BLS decoupled support (#5455)
krishung5 Mar 8, 2023
616dfc1
Extract command line parser into separate file (#5443)
GuanLuo Mar 8, 2023
7890781
Adding test for Model Instance Kind Example added to Python Backend (…
oandreeva-nv Mar 8, 2023
f6590be
Update 'main' to track development of 2.33.0 / r23.04
mc-nv Mar 8, 2023
27f6bdb
Add testing for handling bls error in initialize and finalize functio…
krishung5 Mar 10, 2023
5fa5c95
Fix cmdline parsing bug (#5482)
GuanLuo Mar 13, 2023
943cab8
Add parsing paremters to the HTTP and GRPC frontends (#5490)
Tabrizian Mar 15, 2023
dc209c2
Add onnx and python models back to L0_infer_valgrind test (#5502)
krishung5 Mar 15, 2023
9e20ec8
Generate identity model to test linalg (#5509)
dyastremsky Mar 16, 2023
0e1abf1
Fixing issue in ResolveBackendConfigs (#5505)
oandreeva-nv Mar 16, 2023
9a2e192
Add environment re-extraction test (#5480)
tanmayv25 Mar 16, 2023
0e0b747
Add CodeQL workflow (#5519)
dyastremsky Mar 17, 2023
a58ae56
Add parallel model loading speedup test (#5360)
kthui Mar 17, 2023
179ea0e
Initialize np_dtype_string during model generation (#5526)
dyastremsky Mar 20, 2023
7cf1788
Add libtorch ragged test in L0_batcher (#5522)
GuanLuo Mar 20, 2023
127b9ef
Fix memory leak in http server (#5521)
Tabrizian Mar 20, 2023
5caf139
Add GRPC option for restricted protocol access (#5397)
GuanLuo Mar 21, 2023
030b725
Fix to catch all parser exception and report error (#5529)
GuanLuo Mar 21, 2023
d33cffb
Improve parameters test (#5514)
Tabrizian Mar 21, 2023
5956b58
Small refactoring (if/else paths) (#5539)
dyastremsky Mar 22, 2023
385a12f
Run daily (#5538)
dyastremsky Mar 22, 2023
6e1b7a6
Link Triton tutorials in docs (#5463)
tanayvarshney Mar 23, 2023
864a79d
Add CITATION.cff (#5541)
rmccorm4 Mar 23, 2023
25f2121
Adding repo tag to torch.hub.load to fix compatibility issues (#5557)
oandreeva-nv Mar 28, 2023
371e019
Enable model namespacing in SageMaker entrypoint (#5540)
nikhil-sk Mar 29, 2023
6c50033
Upgrade mlflow package to address vulnerability (#5569)
tanmayv25 Mar 29, 2023
7de03e5
Update README and versions for 23.03 branch
mc-nv Mar 9, 2023
d87f3f7
Update path for CUDA 12.1
mc-nv Mar 7, 2023
12c2321
Change CMAKE version
mc-nv Mar 10, 2023
54341fa
Add testing for async and streaming
Tabrizian Mar 13, 2023
08ccc8e
Add documentation and reserved parameters list
Tabrizian Mar 14, 2023
da37089
Revert changes added to the wrong file.
mc-nv Mar 15, 2023
c3c4bc8
Update TensorRT generation script for Jetson
mc-nv Mar 15, 2023
5df9eb5
Update Dockerfile.win10.min (#5531)
mc-nv Mar 22, 2023
f14c4d0
Removing explicit usage of in favor of (#5570)
oandreeva-nv Mar 30, 2023
f63e15f
Add testing for model getting killed during initialization (#5554)
krishung5 Mar 30, 2023
2f20e69
Add json datatype checks (#5560)
Tabrizian Mar 31, 2023
e005a43
Adding the fixes for arm32 (#4901)
thmca Mar 31, 2023
d4cc9ae
Add documentation for sequence request timeout. Add test (#5571)
GuanLuo Mar 31, 2023
8408afa
Make string checks more resilient to minor format changes in L0_impli…
rmccorm4 Apr 5, 2023
b0e22ff
Fix L0_implicit_state (#5595)
rmccorm4 Apr 5, 2023
301cc4a
Increase the test verbosity for better visibility into inconsistent f…
tanmayv25 Apr 6, 2023
8c8e2a2
Fix L0_backend_python lifecycle test (#5597)
krishung5 Apr 6, 2023
0bba82c
Add testing for Python BLS preferred memory configuration (#5580)
krishung5 Apr 6, 2023
87b7bab
Made requested change by GKE to meet expectation (#5535)
mengdong Apr 6, 2023
0c3e816
Add support for forwarding HTTP/GRPC headers (#5575)
Tabrizian Apr 6, 2023
57529c4
Remove support for TensorFlow 1 (#5604)
krishung5 Apr 7, 2023
2b73601
Reorder the test (#5607)
kthui Apr 8, 2023
45e397f
Fix L0_tf_parameters (#5612)
krishung5 Apr 10, 2023
5110d7f
Fix metric address in cmdline (#5620)
GuanLuo Apr 10, 2023
ac10154
Fix L0_logging with new number of logs (#5621)
tanmayv25 Apr 11, 2023
4925397
Fix L0_batcher on SBSA machines (#5618)
tanmayv25 Apr 11, 2023
56641bf
Add --metrics-config, docs, and tests (#5619)
rmccorm4 Apr 11, 2023
8be0f60
Separate CUDA and system memory imports (#5623)
dyastremsky Apr 11, 2023
7f82373
Add python client unit testing to the CI (#5591)
debermudez Apr 11, 2023
3c8d930
Remove extra quotes for shmem in nomodel test (#5628)
dyastremsky Apr 12, 2023
f3e5d8b
Define NOMINMAX when compiling triton server (#5625)
tanmayv25 Apr 12, 2023
2d9fdcc
Fix L0_memory_growth (#5631)
krishung5 Apr 12, 2023
135e205
Modify build.py to include tests in backend repo into CI (#5630)
GuanLuo Apr 12, 2023
caeb479
Implement s3 support for MLFLow plugin (#5435)
Apr 17, 2023
a010911
Reduce default --model-load-thread-count to 4 (#5650)
rmccorm4 Apr 17, 2023
f19edac
Remove unused imports (#5652)
dyastremsky Apr 18, 2023
5f9b11a
Opentelemetry trace support for Triton tracing (#5637)
oandreeva-nv Apr 18, 2023
4f80b90
Update log file extension (#5655)
mc-nv Apr 18, 2023
c764d72
Add documentation for forwarding headers (#5662)
Tabrizian Apr 19, 2023
aba5f78
Add TensorRT error propagation test (#5651)
kthui Apr 19, 2023
5416694
Update Dockerfile.win10.min structure (#5657)
mc-nv Apr 19, 2023
7a3b06b
Give sufficient time to get inference statistics for sequence tests (…
dyastremsky Apr 21, 2023
f46d3fb
Categorize tritonserver CLI options into groups (#5653)
rmccorm4 Apr 24, 2023
c032ec3
Add higher --max-trials to L0_perf tests with configurable PA_MAX_TRI…
rmccorm4 Apr 25, 2023
1c6d3cc
Add testing for pa doc links (#5599)
debermudez Apr 25, 2023
2edf3aa
Give sufficient time to get inference statistics for batcher tests (#…
dyastremsky Apr 25, 2023
ea0851d
Fix PyTorch Neuron package name (#5692)
GuanLuo Apr 26, 2023
7972140
Add model instance update test (#5635)
kthui Apr 26, 2023
bd664a0
Update README and docs post-23.04 release (#5707)
mc-nv Apr 27, 2023
a85cba0
Changed copyright (#5705)
oandreeva-nv Apr 27, 2023
10567be
Modify timeout test in L0_sequence_batcher to use portable backend (#…
GuanLuo Apr 27, 2023
f35adeb
updated upstream container name (#5713)
nnshah1 Apr 27, 2023
ec6d6f6
Fix triton container version (#5714)
tanmayv25 Apr 27, 2023
430a4a9
Update the L0_model_config test expected error message (#5684)
krishung5 Apr 28, 2023
dceee5e
Use better value in timeout test L0_sequence_batcher (#5716)
GuanLuo Apr 28, 2023
3eb9e72
Update JAX install (#5613)
kthui Apr 28, 2023
1453c44
Add notes about socket usage to L0_client_memory_growth test (#5710)
rmccorm4 Apr 29, 2023
4489068
Check TensorRT error message more granularly (#5719)
kthui May 1, 2023
c2e263c
Pin Python Package Versions for HTML Document Generation (#5727)
nnshah1 May 2, 2023
cca23a5
Test full error returned when custom batcher init fails (#5729)
dyastremsky May 2, 2023
37bdd38
Add fastertransformer test (#5500)
jbkyang-nvi May 3, 2023
8c40783
Fix L0_backend_python on Jetson (#5728)
dyastremsky May 3, 2023
85fe964
Add testing for Python custom metrics API (#5669)
krishung5 May 4, 2023
89784fd
Add testing for Triton Client Plugin API (#5706)
Tabrizian May 4, 2023
dfacc29
Install jemalloc (#5738)
krishung5 May 5, 2023
ea23588
Add --metrics-address and testing (#5737)
rmccorm4 May 5, 2023
0ae0764
Add testing for basic auth plugin for HTTP/gRPC clients (#5739)
Tabrizian May 8, 2023
3d3d450
Add multi-gpu, multi-stream testing for dlpack tensors (#5550)
oandreeva-nv May 8, 2023
51fde69
Update note on SageMaker MME support for ensemble (#5723)
casassg May 8, 2023
4406a8f
Run L0_backend_python subtests with virtual environment (#5753)
krishung5 May 9, 2023
1c4ec56
Update 'main' to track development of 2.35.0 / r23.06 (#5764)
mc-nv May 10, 2023
d000de6
Include jemalloc into the documentation (#5760)
krishung5 May 10, 2023
aa5877b
Enhance tests in L0_model_update (#5724)
kthui May 12, 2023
a958c6a
Fix L0_memory_growth (#5795)
rmccorm4 May 16, 2023
c6e740f
Add note on --metrics-address (#5800)
rmccorm4 May 16, 2023
c8cf4c0
Minor fix for running "mlflow deployments create -t triton --flavor t…
yeahdongcn May 16, 2023
234735b
Adding test for new sequence mode (#5771)
debermudez May 17, 2023
1f4ecb1
MLFlow Triton Plugin: Add support for s3 prefix and custom endpoint U…
yeahdongcn May 17, 2023
bd798f0
Fix client script (#5806)
krishung5 May 18, 2023
5d5dbc3
Add MLFlow test for already loaded models. Update copyright year (#5808)
GuanLuo May 18, 2023
fae59a5
Use the correct gtest filter (#5824)
krishung5 May 22, 2023
429dc14
Add error message test on S3 access decline (#5825)
kthui May 22, 2023
5fd844d
Restore AWS_SECRET_ACCESS_KEY on S3 local test (#5832)
kthui May 23, 2023
261b1e7
nnshah1 stream infer segfault fix (#5842)
nnshah1 May 23, 2023
73ef723
Remove unused test (#5851)
dyastremsky May 25, 2023
b18992d
Add and document memory usage in statistic protocol (#5642)
GuanLuo May 25, 2023
2904215
use correct lib dir on CentOS (#5836)
ax-vivien May 26, 2023
8475992
Document that gpu-base flag is optional for cpu-only builds (#5861)
dyastremsky May 26, 2023
750fb8f
Update Jetson tests in Docker container (#5734)
dyastremsky May 31, 2023
b909953
Update `main` post-23.05 release (#5880)
mc-nv Jun 1, 2023
dd32069
Disable memory tracker on Jetpack until the library is available (#5882)
GuanLuo Jun 1, 2023
6628294
Fix datadir for x86 (#5894)
dyastremsky Jun 2, 2023
0fccb7c
Add more test on instance signature (#5852)
kthui Jun 2, 2023
1420929
Add testing for new error handling API (#5892)
Tabrizian Jun 5, 2023
ade8766
Test batch input for libtorch (#5855)
dyastremsky Jun 6, 2023
fe29def
Clean up Azure dependency in server build (#5900)
GuanLuo Jun 6, 2023
76c7122
Add response parameters for streaming GRPC inference to enhance decou…
rmccorm4 Jun 7, 2023
950f98b
Update README and versions for 23.06 branch
mc-nv Jun 6, 2023
7145fe0
Update README.md for 23.06
mc-nv Jun 6, 2023
6d8f499
Add test for detecting S3 http2 upgrade request (#5911)
kthui Jun 8, 2023
ec0d9ec
Add Redis cache build, tests, and docs (#5916)
rmccorm4 Jun 8, 2023
d481cc9
Ensure HPCX dependencies found in container (#5922)
dyastremsky Jun 11, 2023
993c89a
Add testing for Pytorch instance group kind MODEL (#5810)
krishung5 Jun 13, 2023
811d8b1
Fix LD_LIBRARY_PATH for PyTorch backend
Tabrizian Jun 13, 2023
dad9013
Add docs on decoupled final response feature (#5936)
rmccorm4 Jun 20, 2023
992ef40
Remove only MPI libraries in HPCX in L0_perf_analyzer (#5967)
dyastremsky Jun 21, 2023
9300710
Update README and add RELEASE notes for 23.06 (#5991)
Tabrizian Jun 28, 2023
78d5262
Test additions. Do not install boost yet
fpetrini15 May 9, 2024
b1b8e67
Now add boost dependency
fpetrini15 May 10, 2024
99135e1
Fix typo
fpetrini15 May 10, 2024
a1714eb
Restructure/typo
fpetrini15 May 10, 2024
e0fb264
Add CI test
fpetrini15 May 14, 2024
40d5623
Copyright
fpetrini15 May 14, 2024
ecc425b
Restore variable
fpetrini15 May 14, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
2 changes: 1 addition & 1 deletion .clang-format
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
BasedOnStyle: Google

IndentWidth: 2
ContinuationIndentWidth: 2
ContinuationIndentWidth: 4
UseTab: Never
MaxEmptyLinesToKeep: 2

Expand Down
24 changes: 24 additions & 0 deletions .github/ISSUE_TEMPLATE/bug_report.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,24 @@
---
name: Bug report
about: Create a report to help us improve
title: ''
labels: ''
assignees: ''

---

**Description**
A clear and concise description of what the bug is.

**Triton Information**
What version of Triton are you using?

Are you using the Triton container or did you build it yourself?

**To Reproduce**
Steps to reproduce the behavior.

Describe the models (framework, inputs, outputs), ideally include the model configuration file (if using an ensemble include the model configuration file for that as well).

**Expected behavior**
A clear and concise description of what you expected to happen.
20 changes: 20 additions & 0 deletions .github/ISSUE_TEMPLATE/feature_request.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,20 @@
---
name: Feature request
about: Suggest an idea for this project
title: ''
labels: ''
assignees: ''

---

**Is your feature request related to a problem? Please describe.**
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

**Describe the solution you'd like**
A clear and concise description of what you want to happen.

**Describe alternatives you've considered**
A clear and concise description of any alternative solutions or features you've considered.

**Additional context**
Add any other context or screenshots about the feature request here.
90 changes: 90 additions & 0 deletions .github/workflows/codeql.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,90 @@
# Copyright 2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
#
# Redistribution and use in source and binary forms, with or without
# modification, are permitted provided that the following conditions
# are met:
# * Redistributions of source code must retain the above copyright
# notice, this list of conditions and the following disclaimer.
# * Redistributions in binary form must reproduce the above copyright
# notice, this list of conditions and the following disclaimer in the
# documentation and/or other materials provided with the distribution.
# * Neither the name of NVIDIA CORPORATION nor the names of its
# contributors may be used to endorse or promote products derived
# from this software without specific prior written permission.
#
# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS ``AS IS'' AND ANY
# EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
# IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR
# PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR
# CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL,
# EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO,
# PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR
# PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY
# OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
# (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
# OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

name: "CodeQL"

on:
push:
branches: [ 'main' ]
pull_request:
# The branches below must be a subset of the branches above
branches: [ 'main' ]
schedule:
- cron: '0 1 * * 1-6'

jobs:
analyze:
name: Analyze
runs-on: ubuntu-latest
permissions:
actions: read
contents: read
security-events: write

strategy:
fail-fast: false
matrix:
language: [ 'python' ]
# CodeQL supports [ 'cpp', 'csharp', 'go', 'java', 'javascript', 'python', 'ruby' ]
# Learn more about CodeQL language support at https://aka.ms/codeql-docs/language-support

steps:
- name: Checkout repository
uses: actions/checkout@v3

# Initializes the CodeQL tools for scanning.
- name: Initialize CodeQL
uses: github/codeql-action/init@v2
with:
languages: ${{ matrix.language }}
# If you wish to specify custom queries, you can do so here or in a config file.
# By default, queries listed here will override any specified in a config file.
# Prefix the list here with "+" to use these queries and those in the config file.

# Details on CodeQL's query packs refer to:
# https://docs.github.com/en/code-security/code-scanning/automatically-scanning-your-code-for-vulnerabilities-and-errors/configuring-code-scanning#using-queries-in-ql-packs
queries: +security-and-quality


# Autobuild attempts to build any compiled languages (C/C++, C#, Go, or Java).
# If this step fails, then you should remove it and run the build manually (see below)
- name: Autobuild
uses: github/codeql-action/autobuild@v2

# Command-line programs to run using the OS shell.
# See https://docs.github.com/en/actions/using-workflows/workflow-syntax-for-github-actions#jobsjob_idstepsrun

# If the Autobuild fails above, remove it and uncomment the following three lines.
# modify them (or add more) to build your code if your project, please refer to the EXAMPLE below for guidance.

# - run: |
# echo "Run, Build Application using script"
# ./location_of_script_within_repo/buildscript.sh

- name: Perform CodeQL Analysis
uses: github/codeql-action/analyze@v2
with:
category: "/language:${{matrix.language}}"
18 changes: 7 additions & 11 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -1,11 +1,7 @@
/bazel-bin
/bazel-ci_build-cache
/bazel-genfiles
/bazel-trtserver
/bazel-out
/bazel-serving
/bazel-tensorflow
/bazel-tensorflow_serving
/bazel-testlogs
/bazel-tf
/bazel-workspace
/build
/builddir
/.vscode
*.so
__pycache__
tmp
*.log
7 changes: 7 additions & 0 deletions CITATION.cff
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
cff-version: 1.2.0
message: "If you use this software, please cite it as below."
title: "Triton Inference Server: An Optimized Cloud and Edge Inferencing Solution."
url: https://github.com/triton-inference-server
repository-code: https://github.com/triton-inference-server/server
authors:
- name: "NVIDIA Corporation"
Loading