Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Continuous Clearing Tool Version 7.0.0 release #203

Closed
wants to merge 108 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
108 commits
Select commit Hold shift + click to select a range
edecf09
Merge pull request #173 from siemens/feature/hashaddition
Vijayalakshmi027 Jun 11, 2024
531341e
Standardize CA SBOM to Siemens SBOM
ragavareddychalapala Jun 11, 2024
889cb6d
Merge branch 'development' into StandardizeCASBOMtoSiemensSBOM_22052024
crvreddy Jun 11, 2024
3f3e9f8
Removed unnessasary things
ragavareddychalapala Jun 11, 2024
2957aa3
refactored code
ragavareddychalapala Jun 11, 2024
80e1173
Remove duplicate dependencies
ragavareddychalapala Jun 12, 2024
2ab1cd0
file alignment fixed
ragavareddychalapala Jun 12, 2024
76812a4
Updated method name
ragavareddychalapala Jun 12, 2024
18257d9
Unit test issues fixed
ragavareddychalapala Jun 12, 2024
d729524
Discription removed
ragavareddychalapala Jun 12, 2024
19db58e
Bugfix: Python identification
karthika-g Jun 13, 2024
0dc6b45
Merge pull request #175 from siemens/feature/hashaddition
karthika-g Jun 13, 2024
209a4b3
Merge pull request #174 from siemens/StandardizeCASBOMtoSiemensSBOM_2…
Vijayalakshmi027 Jun 13, 2024
73bd570
Bug fix conan and debian
karthika-g Jun 13, 2024
44432dc
logs added
karthika-g Jun 14, 2024
18c1f2a
logs added
karthika-g Jun 14, 2024
c8a6917
sbom_siemens_direct_filname_dev
Jun 14, 2024
cd044ce
Merge pull request #176 from siemens/feature/hashaddition
karthika-g Jun 14, 2024
1ac74b8
Mavenpackage name
Jun 14, 2024
9d38901
componene description update
Jun 14, 2024
7b47bdc
merge with dev branch
Jun 15, 2024
d2aeefa
repo path added to props
Jun 24, 2024
5fdb6c0
migration from .net 6 to .net 8
Jun 24, 2024
faa60b8
Debian simens direct fix
Jun 26, 2024
177354d
test files update
Jun 28, 2024
b836956
Error fix maven parser
karthika-g Jun 28, 2024
0b04108
Merge branch 'feature/stdbom_siemens_final_dev' of https://github.com…
karthika-g Jun 28, 2024
f2facf4
integrated test cases issues fix
ragavareddychalapala Jul 7, 2024
dcf1a57
updated
ragavareddychalapala Jul 7, 2024
f7a7dd2
Integrated test cases fixes
ragavareddychalapala Jul 8, 2024
f5c5cc9
component creation bug and UT fix
Jul 8, 2024
a5ef3fe
updated files
ragavareddychalapala Jul 8, 2024
e3c3185
Artifactory Upload changes
ragavareddychalapala Jul 8, 2024
d950a6d
Pushed missed files
ragavareddychalapala Jul 8, 2024
4093399
Bug fix for conan
ragavareddychalapala Jul 8, 2024
bae0c25
Refactored code
ragavareddychalapala Jul 9, 2024
fe9d3ed
added new test case for adding sample component intest servers
ragavareddychalapala Jul 10, 2024
f870724
updated newly created test case
ragavareddychalapala Jul 10, 2024
5ef96f6
Merge pull request #182 from siemens/stdbom_IntegratedTestCasesFix_05…
Vijayalakshmi027 Jul 10, 2024
4923423
Updated artifactoryuploader files and updated testcases
ragavareddychalapala Jul 10, 2024
0ffc2e9
Update compile.yml
prasenjeetnath Jul 10, 2024
0fae9fa
Merge pull request #184 from siemens/stdbom_IntegratedTestCasesFix_05…
Vijayalakshmi027 Jul 10, 2024
b8e09ba
Unit test cases added
Jul 11, 2024
0a209f5
Added unit test cases
Jul 11, 2024
6db7d44
identifier test cases are added
Jul 11, 2024
882ca7d
Updated created and artifactory files data .
ragavareddychalapala Jul 11, 2024
e3f093f
updated property repo name
ragavareddychalapala Jul 12, 2024
ab0051d
migrated version updated in all files
Jul 12, 2024
27c8da1
Merge branch 'feature/stdbom_siemens_final_dev' of https://github.com…
Jul 12, 2024
247477b
siemens direct property addition when we read packages less than angu…
Jul 23, 2024
d934dbb
version update in compile yml
Jul 23, 2024
2112f37
conan process bug fix
Jul 23, 2024
e2b2d70
nuspec file update and appsetting version update
Jul 23, 2024
064847b
docker file copy file command update
Jul 24, 2024
5b936e6
Merge pull request #178 from siemens/feature/stdbom_siemens_final_dev
Vijayalakshmi027 Jul 24, 2024
f82238c
version update in ca tool projects
Jul 24, 2024
9bea4a3
test cse fix UT and IT
Jul 24, 2024
dcaaad8
ut fix
Jul 24, 2024
79f3f63
UT addition
Jul 24, 2024
7f933a0
Merge pull request #188 from siemens/feat/version_update_catool_projects
Vijayalakshmi027 Jul 24, 2024
879fe49
Initial (#189)
sumanthkb44 Jul 25, 2024
ba05e2a
Merge pull request #190 from siemens/feature/skip_changesfor_ut_it
Vijayalakshmi027 Jul 25, 2024
64678c1
publish catool logs and bom to pipeline artifacts
Jul 26, 2024
7ae816e
test case fix
Jul 26, 2024
00dc8d4
artifact name updated
Jul 26, 2024
35d079a
ut fix
Jul 26, 2024
a3c6ea5
Update appSettingsSW360IntegrationTest.json
Vijayalakshmi027 Jul 26, 2024
0890eec
IT fix
Jul 26, 2024
3b5496c
PUblish to artifact new module creation
Jul 31, 2024
66ed38b
publish artifact
Jul 31, 2024
08b3c5d
container separation for log and boms
Jul 31, 2024
1614124
test case update
Jul 31, 2024
d435193
publish artifact
Jul 31, 2024
d243c57
publish artifact
Jul 31, 2024
235da76
publish bom to pipeline artifact
Jul 31, 2024
2b1ab6d
Container folder name changes
Jul 31, 2024
0de1b59
unit test update
Jul 31, 2024
7dc8a5d
UT fix
Aug 1, 2024
dd77dd5
UT fix
Aug 2, 2024
5e1da41
test case fix
Aug 2, 2024
12b76bb
nuspec file update
Aug 4, 2024
d04d468
publish artifact
Aug 5, 2024
84297b4
publish artifact
Aug 5, 2024
e51f919
test case fix
ragavareddychalapala Aug 5, 2024
93b83b4
unit test cases fixed
ragavareddychalapala Aug 5, 2024
5cb214b
Exit code fix
Aug 6, 2024
d7ed7f1
Merge branch 'feat/publish_bom_to_artifact' of https://github.com/sie…
Aug 6, 2024
554eb9f
Exit code update
Aug 6, 2024
ff12c08
Bug fix for metadata
ragavareddychalapala Aug 6, 2024
86cef13
Merge pull request #193 from siemens/catooltest7.0
Vijayalakshmi027 Aug 6, 2024
eaf3d70
uncommented test cases
ragavareddychalapala Aug 6, 2024
1b2c7bd
Merge pull request #192 from siemens/feat/publish_bom_to_artifact
Vijayalakshmi027 Aug 6, 2024
7346c2b
updated release relation
ragavareddychalapala Aug 20, 2024
dddb315
Merge pull request #197 from siemens/Catool7.0requestedchanges
crvreddy Aug 21, 2024
65b208a
removed unnessasary publish artifacts
ragavareddychalapala Aug 21, 2024
9950ea1
Merge pull request #198 from siemens/Catool7.0requestedchanges
Vijayalakshmi027 Aug 22, 2024
dc82754
Installing specific version of OpenJDK (#199)
sumanthkb44 Aug 26, 2024
8d8d041
removed python3.11 component due to obligation of clearing team
ragavareddychalapala Aug 27, 2024
7c46de1
removed command
ragavareddychalapala Aug 29, 2024
e5f9c0c
updated
ragavareddychalapala Aug 29, 2024
529e991
reverted changes
ragavareddychalapala Aug 29, 2024
6b57023
updated command
ragavareddychalapala Aug 29, 2024
8336520
fix: Open jdk installation issue in the docker file
Aug 29, 2024
959c507
Update Dockerfile
adityanarayanp Aug 30, 2024
9aebab8
remove python3.11 packages
ragavareddychalapala Sep 1, 2024
a92bc12
Merge pull request #200 from siemens/RemoveDebianpackageforclearence
Vijayalakshmi027 Sep 2, 2024
a17f39f
Updated Readme files
ragavareddychalapala Sep 3, 2024
498a12e
Merge pull request #202 from siemens/Readmeosfor7.0.0
Vijayalakshmi027 Sep 3, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
20 changes: 10 additions & 10 deletions .github/workflows/compile.yml
Original file line number Diff line number Diff line change
Expand Up @@ -66,13 +66,13 @@ jobs:
run: |
dotnet build src\LicenseClearingTool.sln
Write-Host "Files in directory:"
dir $env:GITHUB_WORKSPACE\out\net6.0
dir $env:GITHUB_WORKSPACE\out\net8.0

- name: Upload artifact
uses: actions/upload-artifact@v2
with:
name: buildoutput
path: ${{ github.workspace }}/out/net6.0
path: ${{ github.workspace }}/out/net8.0

- name: Archive Build Log
uses: actions/upload-artifact@v2
Expand All @@ -96,7 +96,7 @@ jobs:
$sourceFolder = Join-Path $env:GITHUB_WORKSPACE "out" | Join-Path -ChildPath "*"
$outFolder = Join-Path $env:GITHUB_WORKSPACE "out" | Join-Path -ChildPath "continuous-clearing"
New-Item -ItemType Directory -Force -Path $outFolder
$fileName = "continuous-clearing-v6.2.1.zip"
$fileName = "continuous-clearing-v7.0.0.zip"
Write-Host "Filename: '$fileName'"
Write-Host "sourceFolder: '$sourceFolder'"
Write-Host "Outfolder: '$outFolder'"
Expand Down Expand Up @@ -129,8 +129,8 @@ jobs:
- name: Create Nuget Packages
id: createNupkg
run: |
nuget pack CA.nuspec -Version 6.2.1
Write-Host "::set-output name=nupkg-LicenseClearingTool::continuous-clearing.6.2.1.nupkg"
nuget pack CA.nuspec -Version 7.0.0
Write-Host "::set-output name=nupkg-LicenseClearingTool::continuous-clearing.7.0.0.nupkg"

- name: Archive NuGet Packages
uses: actions/upload-artifact@v2
Expand Down Expand Up @@ -164,9 +164,9 @@ jobs:
#if: ${{ false }} # disable for now
run: |
echo "Files in directory:"
docker build . --file Dockerfile --tag ${{ github.repository }}:continuous-clearing-v6.2.1
docker save ${{ github.repository }}:continuous-clearing-v6.2.1 -o continuous-clearing-v6.2.1.tar
echo "::set-output name=docker-LicenseClearingTool::continuous-clearing-v6.2.1.tar"
docker build . --file Dockerfile --tag ${{ github.repository }}:continuous-clearing-v7.0.0
docker save ${{ github.repository }}:continuous-clearing-v7.0.0 -o continuous-clearing-v7.0.0.tar
echo "::set-output name=docker-LicenseClearingTool::continuous-clearing-v7.0.0.tar"

- name: Archive docker image
#if: ${{ false }} # disable for now
Expand Down Expand Up @@ -214,8 +214,8 @@ jobs:
env:
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
with:
tag_name: v6.2.1
release_name: Release v6.2.1
tag_name: v7.0.0
release_name: Release v7.0.0
body: |
${{ github.event.head_commit.message }}
draft: true
Expand Down
2 changes: 1 addition & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -334,4 +334,4 @@ ASALocalRun/
/Build/runtime/nuget.exe
/Build/runtime/tempNuGet.config
/src/out/netcoreapp3.1
/src/.sonarlint
/src/.sonarlint
404 changes: 216 additions & 188 deletions CA.nuspec

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion CONTRIBUTING.md
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ We welcome contributions in several forms, e.g.
Clone the repository from <CA_Project_RepoLink>

2. Software dependencies -
Visual Studio 2022, .NET Core 6
Visual Studio 2022, .NET 8

## Pull Request Process

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
# Build and test ASP.NET Core projects targeting the full .NET Framework.
# Add steps that publish symbols, save build artifacts, and more:
# https://docs.microsoft.com/azure/devops/pipelines/languages/dotnet-core
# SPDX-FileCopyrightText: 2023 Siemens AG
# SPDX-FileCopyrightText: 2024 Siemens AG
# SPDX-License-Identifier: MIT

resources:
Expand Down
6 changes: 3 additions & 3 deletions DemoProject/DemoProject__azure-pipelines.yml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
# Build and test ASP.NET Core projects targeting the full .NET Framework.
# Add steps that publish symbols, save build artifacts, and more:
# https://docs.microsoft.com/azure/devops/pipelines/languages/dotnet-core
# SPDX-FileCopyrightText: 2023 Siemens AG
# SPDX-FileCopyrightText: 2024 Siemens AG
# SPDX-License-Identifier: MIT

resources:
Expand All @@ -23,15 +23,15 @@ jobs:
displayName: 'Clearing-Package Identifier'
inputs:
script: |
$(Build.SourcesDirectory)\Continuous-Clearing\out\net6.0\PackageIdentifier.exe --packageFilePath "$(Build.SourcesDirectory)\DemoProject\NPMProject" --bomFolderPath "$(Build.SourcesDirectory)\DemoProject\NPMProject" --sw360Token <SW360AUTHTOKEN)> --projectType <ProjectType> --sw360Url <sw360Url> --sW360AuthTokenType Bearer --artifactoryuploadApiKey <JFROGARTIFACTORYTOKEN>) --JfrogApi <JfrogUrl>
$(Build.SourcesDirectory)\Continuous-Clearing\out\net8.0\PackageIdentifier.exe --packageFilePath "$(Build.SourcesDirectory)\DemoProject\NPMProject" --bomFolderPath "$(Build.SourcesDirectory)\DemoProject\NPMProject" --sw360Token <SW360AUTHTOKEN)> --projectType <ProjectType> --sw360Url <sw360Url> --sW360AuthTokenType Bearer --artifactoryuploadApiKey <JFROGARTIFACTORYTOKEN>) --JfrogApi <JfrogUrl>
workingDirectory: 'DemoProject\NPMProject'
failOnStderr: true

- task: CmdLine@2
displayName: 'Clearing-SW360 Package Creator'
inputs:
script: |
$(Build.SourcesDirectory)\Continuous-Clearing\out\net6.0\SW360PackageCreator.exe --bomFilePath "$(Build.SourcesDirectory)\DemoProject\NPMProject\$(SW360PROJNAME)_Bom.cdx.json" --sw360Token <sw360token> --sW360ProjectID <ProjectId> --sW360AuthTokenType Bearer --fossologyUrl <FossURL>
$(Build.SourcesDirectory)\Continuous-Clearing\out\net8.0\SW360PackageCreator.exe --bomFilePath "$(Build.SourcesDirectory)\DemoProject\NPMProject\$(SW360PROJNAME)_Bom.cdx.json" --sw360Token <sw360token> --sW360ProjectID <ProjectId> --sW360AuthTokenType Bearer --fossologyUrl <FossURL>
workingDirectory: 'DemoProject\NPMProject'
failOnStderr: true

Expand Down
8 changes: 4 additions & 4 deletions DemoProject/DemoProject__azure-pipelines_Debian.yml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
# Build and test ASP.NET Core projects targeting the full .NET Framework.
# Add steps that publish symbols, save build artifacts, and more:
# https://docs.microsoft.com/azure/devops/pipelines/languages/dotnet-core
# SPDX-FileCopyrightText: 2023 Siemens AG
# SPDX-FileCopyrightText: 2024 Siemens AG
# SPDX-License-Identifier: MIT

resources:
Expand Down Expand Up @@ -55,23 +55,23 @@ stages:
inputs:
SourceFolder: '$(Build.SourcesDirectory)'
Contents: 'appSettings*.json'
TargetFolder: '$(Build.SourcesDirectory)\Continuous-Clearing\out\net6.0'
TargetFolder: '$(Build.SourcesDirectory)\Continuous-Clearing\out\net8.0'
OverWrite: true

- task: CmdLine@2
enabled: true
displayName: 'PackageIdentifier'
inputs:
script: |
$(Build.SourcesDirectory)\Continuous-Clearing\out\net6.0\PackageIdentifier.exe --packageFilePath "<debpackageOutfilepath>" --bomFolderPath "$(Build.SourcesDirectory)\GridEdge" --sw360Token <SW360AUTHTOKEN> --sW360ProjectID <projectid> --sW360AuthTokenType Bearer --artifactoryuploadApiKey <JFRogApitoken> --projectType DEBIAN
$(Build.SourcesDirectory)\Continuous-Clearing\out\net8.0\PackageIdentifier.exe --packageFilePath "<debpackageOutfilepath>" --bomFolderPath "$(Build.SourcesDirectory)\GridEdge" --sw360Token <SW360AUTHTOKEN> --sW360ProjectID <projectid> --sW360AuthTokenType Bearer --artifactoryuploadApiKey <JFRogApitoken> --projectType DEBIAN
workingDirectory: $(Build.SourcesDirectory)
continueOnError: true
- task: CmdLine@2
enabled: true
displayName: 'component creator'
inputs:
script: |
$(Build.SourcesDirectory)\Continuous-Clearing\out\net6.0\SW360PackageCreator.exe --bomFilePath "$(Build.SourcesDirectory)\GridEdge\$(SW360PROJNAME)_Bom.cdx.json" --sw360Token <SW360AUTHTOKEN> --sW360ProjectID <ProjectId> --sW360AuthTokenType Bearer --fossologyUrl <FossURL>
$(Build.SourcesDirectory)\Continuous-Clearing\out\net8.0\SW360PackageCreator.exe --bomFilePath "$(Build.SourcesDirectory)\GridEdge\$(SW360PROJNAME)_Bom.cdx.json" --sw360Token <SW360AUTHTOKEN> --sW360ProjectID <ProjectId> --sW360AuthTokenType Bearer --fossologyUrl <FossURL>
workingDirectory: $(Build.SourcesDirectory)
continueOnError: true

Expand Down
4 changes: 2 additions & 2 deletions DemoProject/LicenseClearingTool.bat
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
REM SPDX-FileCopyrightText: 2023 Siemens AG
REM SPDX-FileCopyrightText: 2024 Siemens AG
REM SPDX-License-Identifier: MIT

@ECHO OFF
pushd %~dp0\LicenseClearingTool.3.0.0
pushd %~dp0\LicenseClearingTool.7.0.0
echo "Starting Package Identifier"
cmd.exe /c Package Identifier.exe --packageFilePath ..\NPMProject --bomFolderPath ..\BOM --sw360Token <sw360token> --sW360ProjectID <ProjectId> --sW360AuthTokenType Bearer --artifactoryuploadApiKey <artifactoryuploadApiKey> --projectType <ProjectType> --JfrogApi <JfrogUrl> --sw360Url <sw360Url>

Expand Down
29 changes: 21 additions & 8 deletions Dockerfile
Original file line number Diff line number Diff line change
@@ -1,30 +1,43 @@
# SPDX-FileCopyrightText: 2024 Siemens AG
# SPDX-License-Identifier: MIT

# Get parent image as latest debian patch of bullseye
FROM mcr.microsoft.com/dotnet/sdk:6.0-bullseye-slim-amd64
FROM mcr.microsoft.com/dotnet/sdk:8.0-bookworm-slim
WORKDIR /app/out

# Creating required directories
RUN mkdir /opt/DebianImageClearing && \
mkdir /mnt/Input && \
mkdir /mnt/Output && \
mkdir /etc/CATool && \
mkdir /app/out/PatchedFiles

# Installing required packages
# Installing syft:v0.90.0
# Installing specific version of openjdk
RUN apt-get update && \
apt-get -y install --no-install-recommends nodejs npm && \
apt-get -y install --no-install-recommends git && \
apt-get -y install --no-install-recommends maven && \
apt-get -y install --no-install-recommends curl && \
apt-get -y install --no-install-recommends dpkg-dev && \
curl -sSfL https://raw.githubusercontent.com/anchore/syft/main/install.sh | sh -s -- -b /opt/DebianImageClearing v0.90.0 && \
apt-get -y install --no-install-recommends dpkg-dev && \
dpkg -r --force-depends python3-minimal && \
dpkg -r --force-depends libpython3.11-minimal:amd64 && \
dpkg -r --force-depends libpython3.11-stdlib:amd64 && \
dpkg -r --force-depends python3.11 && \
dpkg -r --force-depends python3.11-minimal && \
dpkg --purge libpython3.11-minimal:amd64 && \
dpkg --purge python3.11-minimal && \
curl -sSfL https://raw.githubusercontent.com/anchore/syft/main/install.sh | sh -s -- -b /opt/DebianImageClearing v0.90.0

RUN apt-get update && \
curl -L -o openjdk-17-jre-headless_17.0.9+9-1~deb12u1_amd64.deb https://snapshot.debian.org/archive/debian-security/20231105T195436Z/pool/updates/main/o/openjdk-17/openjdk-17-jre-headless_17.0.9+9-1~deb12u1_amd64.deb && \
dpkg -i openjdk-17-jre-headless_17.0.9+9-1~deb12u1_amd64.deb && \
rm -rf /var/lib/apt/lists/* && \
rm -rf archive.tar.gz

ENV PATH="/root/.local/bin:$PATH"

# Copying files from host to current working directory
# COPY /out/net8.0 /app/out
COPY /buildoutput/ /app/out
Loading
Loading