forked from kotekan/kotekan
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Send baseband to a receiver node instead of writing files directly (k…
…otekan#927) This change tears out the logic that existed to write baseband into files (i.e., over NFS) from the basebandReadout stage, and makes it truly just a "readout": when a baseband request arrives, the stage now copies out the requested data into an output Kotekan buffer, with event details recorded in the output frame metadata. The idea is that the output buffer will simply be forwarded to a baseband receiver node using a `bufferSend` stage. Also adds multi-frequency support. Co-authored-by: chitrang <[email protected]> Co-authored-by: Andre Renard <[email protected]>
- Loading branch information
3 people
authored
Nov 30, 2021
1 parent
84aa90c
commit 11fead5
Showing
46 changed files
with
3,146 additions
and
622 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,67 @@ | ||
| ######################################### | ||
| # | ||
| # chime_science_run_recv_baseband.yaml | ||
| # | ||
| # CHIME baseband receiver node configuration. | ||
| # | ||
| # Receives baseband dump frames from each GPU node and writes them in a raw | ||
| # output file. | ||
| # | ||
| # Author: Davor Cubranic | ||
| # | ||
| ########################################## | ||
| --- | ||
| type: config | ||
| log_level: info | ||
| num_elements: 2048 | ||
| num_local_freq: 1 | ||
| num_data_sets: 1 | ||
| samples_per_data_set: 512 | ||
| buffer_depth: 64 | ||
| cpu_affinity: [0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15] | ||
|
|
||
| # Constants | ||
| sizeof_float: 4 | ||
| sizeof_int: 4 | ||
| sizeof_short: 2 | ||
|
|
||
| dataset_manager: | ||
| use_dataset_broker: False | ||
| ds_broker_host: "10.1.50.11" # recv1 | ||
| ds_broker_port: 12050 | ||
|
|
||
| telescope: | ||
| name: CHIMETelescope | ||
| require_gps: false | ||
|
|
||
| # Baseband Metadata Pool | ||
| baseband_metadata_pool: | ||
| kotekan_metadata_pool: BasebandMetadata | ||
| num_metadata_objects: 65536 | ||
|
|
||
| basdband_bufs: | ||
| metadata_pool: baseband_metadata_pool | ||
| frame_size: num_elements * samples_per_data_set | ||
| num_frames: 180 * 96 | ||
| baseband_recv_buffer_0: | ||
| kotekan_buffer: standard | ||
|
|
||
| # Kotekan stages | ||
| baseband_recv: | ||
| drop_frames: false | ||
| connection_timeout: 600 # 10 Minutes | ||
| recv_0: | ||
| kotekan_stage: bufferRecv | ||
| buf: baseband_recv_buffer_0 | ||
| listen_port: 11027 | ||
|
|
||
| write_baseband: | ||
| root_path: /data/baseband_raw/ | ||
| dump_timeout: 1200 # 20 Minutes | ||
| write_0: | ||
| kotekan_stage: BasebandWriter | ||
| in_buf: baseband_recv_buffer_0 | ||
|
|
||
| buffer_status: | ||
| kotekan_stage: bufferStatus | ||
| print_status: false |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,60 @@ | ||
| ########################################## | ||
| # | ||
| # pathfinder_recv_baseband.yaml | ||
| # | ||
| # Pathfinder baseband receiver node configuration. | ||
| # | ||
| # Receives baseband dump frames from the PF Kotekan node and writes them to a | ||
| # raw output file. | ||
| # | ||
| # Author: Davor Cubranic and Calvin Leung | ||
| # | ||
| ########################################## | ||
| --- | ||
| type: config | ||
| log_level: info | ||
| num_elements: 256 | ||
| num_local_freq: 8 | ||
| samples_per_data_set: 65536 | ||
| buffer_depth: 64 | ||
| cpu_affinity: [0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15] | ||
|
|
||
| # Constants | ||
| sizeof_float: 4 | ||
| sizeof_int: 4 | ||
| sizeof_short: 2 | ||
|
|
||
| dataset_manager: | ||
| use_dataset_broker: False | ||
|
|
||
| telescope: | ||
| name: ICETelescope | ||
| require_gps: false | ||
|
|
||
| # Baseband Metadata Pool | ||
| baseband_metadata_pool: | ||
| kotekan_metadata_pool: BasebandMetadata | ||
| num_metadata_objects: 65536 | ||
|
|
||
| baseband_recv_buffer: | ||
| kotekan_buffer: standard | ||
| metadata_pool: baseband_metadata_pool | ||
| frame_size: num_elements * samples_per_data_set / 96 | ||
| num_frames: 282 * 96 # max achievable baseband buffer on GPU nodes | ||
|
|
||
| # Kotekan stages | ||
| baseband_recv: | ||
| kotekan_stage: bufferRecv | ||
| buf: baseband_recv_buffer | ||
| listen_port: 11028 | ||
|
|
||
| # Write raw baseband data | ||
| write_baseband: | ||
| root_path: /data/pf_baseband_raw/ | ||
|
|
||
| kotekan_stage: BasebandWriter | ||
| in_buf: baseband_recv_buffer | ||
|
|
||
| buffer_status: | ||
| kotekan_stage: bufferStatus | ||
| print_status: false |
Oops, something went wrong.