Skip to content

Commit

Permalink
Signal Synchronization and Project Refactoring (#558)
Browse files Browse the repository at this point in the history
* Start refactoring sync and filtering

* Creating classes for each modality

* Adding notebooks

* Adding notebook

* Fixing requirements.txt

* Rearranging folders

* Adding notebook

* Upsampling

* Working on sync

* Synch and saving to database

* Filtering fnirs

* updates

* Sync signals ready

* Refactoring to use settings

* Refactored raw table population

* Refactoring vocalics extraction

* Working on sync data

* More progress towards sync

* More on synching

* More progress on fnirs sync

* Adding tables explicitly as foreign key

* Synching EEG

* Linting

* Fixing non sorted timestamps

* Saving all records

* Allowing db_pass to be none

* Importing all tables

* Adding advisor in the group session workbook

* Fixing field

* Small fix

* Small update

* Small update

* Skipping group session if already saved

* Skipping eeg device if existent

* Order of processing

* Fixing path

* small fix

* small fix

* Small fix on gaze

* Gaze

* Gaze

* Limiting number of connections

* Gaze as before

* small fix

* Task nullable

* Optional gaze

* Small fix screen capture

* Changing processing order

* Executable sync

* Adding header executable python

* Add vocalics as part of the raw tables

* Small fix

* Fixing vocalics

* Small fix

* Retrieving rest state times if csv file is empty.

* Including name of the ,odality in the sync script

* Add num jobs as an env variable

* Improving readme

* Updating metadata.yml

* To sqlite

* Setting sqlitetmp_directory

* Skipping stations with no raw signal for them

* Creating individual connections if execution in parallel

* Minor fix

* Skipping processed group sessions

* Skipping processed group sessions

* Adding missing import

* Workaround clock timestamps when there's no MC

* Minor typo

* Uncommenting to_sqlite statement

* Adding more info to understand why some signals are not being saved.

* Adding more info to understand why some signals are not being saved.

* Allowing update a subset of tables with env variable

* Importing missing library

* Adding to_sqlite to the Makefile

* Removing data_pre_processing project

* Synchronizing gsr and ekg and swapping on raw when needed

* Passing swap function to signal processing

* Removing log about swapping

* Syncing gsr and ekg

* Skipping sync if filtering breaks

* Uncommenting make commands for sync other modalities

* adding raw signals to fnirs table

* Temp modification

* minor fix
PS

* minor fix

---------

Co-authored-by: Paulo Soares <[email protected]>
Co-authored-by: Paulo Soares <[email protected]>
Co-authored-by: Paulo Soares <[email protected]>
Co-authored-by: Paulo Soares <[email protected]>
Co-authored-by: Paulo Soares <[email protected]>
Co-authored-by: Paulo Soares <[email protected]>
Co-authored-by: Paulo Soares <[email protected]>
Co-authored-by: Paulo Soares <[email protected]>
Co-authored-by: Paulo Soares <[email protected]>
Co-authored-by: Paulo Soares <[email protected]>
Co-authored-by: Paulo Soares <[email protected]>
  • Loading branch information
12 people authored Feb 8, 2024
1 parent c814a17 commit 49f17cb
Show file tree
Hide file tree
Showing 158 changed files with 4,942 additions and 5,589 deletions.
14 changes: 0 additions & 14 deletions human_experiments/data_pre_processing/.gitignore

This file was deleted.

8 changes: 0 additions & 8 deletions human_experiments/data_pre_processing/Makefile

This file was deleted.

84 changes: 0 additions & 84 deletions human_experiments/data_pre_processing/audio/entity/pcm_audio.py

This file was deleted.

This file was deleted.

140 changes: 0 additions & 140 deletions human_experiments/data_pre_processing/audio/fix_audio_header.py

This file was deleted.

Loading

0 comments on commit 49f17cb

Please sign in to comment.