Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

23.10.0 comparison (testing) #23

Open
wants to merge 658 commits into
base: 22.11.1-edge
Choose a base branch
from
Open

Conversation

mageshwaran-lifebit
Copy link

No description provided.

pditommaso and others added 30 commits June 14, 2023 22:46
Signed-off-by: Paolo Di Tommaso <[email protected]>
Signed-off-by: Paolo Di Tommaso <[email protected]>
Signed-off-by: Paolo Di Tommaso <[email protected]>
Signed-off-by: Paolo Di Tommaso <[email protected]>
Signed-off-by: Paolo Di Tommaso <[email protected]>
Signed-off-by: Paolo Di Tommaso <[email protected]>
Signed-off-by: Paolo Di Tommaso <[email protected]>
Signed-off-by: Paolo Di Tommaso <[email protected]>
Signed-off-by: Paolo Di Tommaso <[email protected]>


Signed-off-by: Ben Sherman <[email protected]>
Signed-off-by: Paolo Di Tommaso <[email protected]>
Co-authored-by: Paolo Di Tommaso <[email protected]>

Signed-off-by: Ben Sherman <[email protected]>
Co-authored-by: Marcel Ribeiro-Dantas <[email protected]>
Co-authored-by: Paolo Di Tommaso <[email protected]>
Signed-off-by: Paolo Di Tommaso <[email protected]>
This commit add the `cpu_model` in the Nextflow trace record. 

Note: the field is not included in the default trace file, but it can be added by adding 
in the nextflow config the setting 

```
trace.fields = '..,cpu_model'
```


Signed-off-by: Sabrina Krakau <[email protected]>
Co-authored-by: Paolo Di Tommaso <[email protected]>

Signed-off-by: Ben Sherman <[email protected]>
Signed-off-by: Paolo Di Tommaso <[email protected]>
Co-authored-by: Paolo Di Tommaso <[email protected]>

Signed-off-by: Fritjof Lammers <[email protected]>
Signed-off-by: Fritjof Lammers <[email protected]>
Signed-off-by: Ben Sherman <[email protected]>
Co-authored-by: Ben Sherman <[email protected]>
nxf_parallel runs a number of processes in parallel, distributing them
across a limited number of workers.

Prior to PR nextflow-io#1884, errors were not being checked.  PR#1884 was
intended to remedy this but effectively only checked the _last_
command to exit (which was, unfortunately the case that was tested
for).

Processes that exit while there is still work going on were not being
"waited" on, so their exit status was not being checked, and failures
were escaping unnoticed.

This commit:

- updates the loop that's tracking the work so that it waits on
  processes that have exited; and
- updates the test cases so that the failing command is _not_ the
  last in the list and ensures that the templated text is as expected.


Signed-off-by: George Hartzell <[email protected]>
Co-authored-by: Paolo Di Tommaso <[email protected]>
pditommaso and others added 29 commits October 8, 2023 18:32
This commit adds the -cloudcache run command line option that
allows storing Nextflow cache metadata into a cloud object storage
bucket instead of storing them in the local .nextflow directory.

The target cloud cache path is specified as command line argument,
e.g. -cloudcache s3://bucket-name/path.

Moreover, this commit allows controlling the cloudcache via the
nextflow.config file as shown below:

```
cloudcache.enabled = true|false
cloudcache.path = '<some object storage path>'
```

Supported object storage are AWS S3, Azure Blob storage and Google Storage.

Signed-off-by: Paolo Di Tommaso <[email protected]>
This commit allows disabling the privileged container execution
when using the fusion file system. This can be controlled by using the following 
configuration setting: 

```
 fusion.privileged = true|false // default true
``` 

The effective use of this setting depends on the target execution. 
Currently, it's only supported by the Kubernetes executor which
requires the use the k8s-fuse-plugin to be installed in the target cluster 

More details here https://github.com/nextflow-io/k8s-fuse-plugin



Signed-off-by: Paolo Di Tommaso <[email protected]>

Signed-off-by: Phil Ewels <[email protected]>
Signed-off-by: Paolo Di Tommaso <[email protected]>
Co-authored-by: Paolo Di Tommaso <[email protected]>
Signed-off-by: Paolo Di Tommaso <[email protected]>
Signed-off-by: Paolo Di Tommaso <[email protected]>
Signed-off-by: Paolo Di Tommaso <[email protected]>
Signed-off-by: Paolo Di Tommaso <[email protected]>
Signed-off-by: Paolo Di Tommaso <[email protected]>
Signed-off-by: Paolo Di Tommaso <[email protected]>
Signed-off-by: Paolo Di Tommaso <[email protected]>
Signed-off-by: Paolo Di Tommaso <[email protected]>
Signed-off-by: Paolo Di Tommaso <[email protected]>
Signed-off-by: Ben Sherman <[email protected]>
Signed-off-by: Paolo Di Tommaso <[email protected]>
Co-authored-by: Paolo Di Tommaso <[email protected]>
Signed-off-by: Paolo Di Tommaso <[email protected]>
Signed-off-by: Paolo Di Tommaso <[email protected]>

Signed-off-by: Ben Sherman <[email protected]>
Signed-off-by: Paolo Di Tommaso <[email protected]>
Co-authored-by: Paolo Di Tommaso <[email protected]>

Signed-off-by: Ben Sherman <[email protected]>
Signed-off-by: Paolo Di Tommaso <[email protected]>
Co-authored-by: Phil Ewels <[email protected]>
Co-authored-by: Paolo Di Tommaso <[email protected]>
Signed-off-by: Paolo Di Tommaso <[email protected]>
Signed-off-by: Paolo Di Tommaso <[email protected]>
@mageshwaran-lifebit mageshwaran-lifebit changed the title 23.10.0 comparison 23.10.0 comparison (testing) Jan 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.