Saving multiple results to one csv or appending same columns #111
-
Hello all, this botasaurus has been quite helpful, thanks. I got it to work for a list of 104x product pages where I am saving the same info type from each page (part number, price, manufacturer, link). I tried adding the bt.write_csv but it overwrites the file with each page. Is there a way to write the output from all 104x pages to one csv? Or is there a way to append the new data to the previous columns? I can convert a json to a csv later, but it makes 104x columns of the four above (part number/0, part number/1, etc.). I'm trying to avoid having to write a new py script to append all the columns together in another process. Thanks for any help, Frank |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 1 reply
-
I recommend reading output section of https://github.com/omkarcloud/botasaurus#what-options-can-i-configure-in-all-3-decorators |
Beta Was this translation helpful? Give feedback.
Yes, thanks I found it. In case anyone is struggling, you just add:
@browser(output_formats=bt.Formats.CSV, ...)