v2.0.1

What's Changed

• Fix fake flake8 issues by @code-geek in #976
• Add LRM_QA_{USER, PASSWORD} variable to .django by @Kirandawadi in #985
• Make coding syntax consistent by @Kirandawadi in #990
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #979
• Add CONTRIBUTING.md file by @Kirandawadi in #996
• Add SQLDumpRestoration.md file by @Kirandawadi in #994

New Contributors

• @Kirandawadi made their first contribution in #985
• @pre-commit-ci made their first contribution in #979

Full Changelog: v2.0.0...v2.0.1

v2.0.0

What's Changed

• Feature Enhancements: Integrated several new features, including a "Push to GitHub" button for selected collections, a conversation history webapp, and a JSON indexing template. Enhanced the indexing process with dynamic plugin generation and updated URL indexing endpoints.

• Infrastructure and Configuration Updates: Improved project setup with updated configuration files and added mechanisms for automatic updates, such as using Celery to pull in URLs and updating collections based on production API. Switched Celery broker from Redis to SQS for better scalability.

• Bug Fixes and Stability Improvements: Addressed various bugs, including inference bug fixes, preventing tag duplication, and resolving CORS issues on the frontend. Reverted certain changes for better stability and fixed issues related to job creation and indexing.

• Codebase and API Updates: Introduced significant updates to the codebase, such as adding type hints, refreshing code libraries, and updating API endpoints to accommodate new features and feedback. Implemented functional tests using Selenium for enhanced reliability.

• Admin and User Interface Improvements: Enhanced the webapp user experience by refining the UI, including removing clutter, automating file creation at specific status changes, and aligning webapp status implementation with the current process. Added admin actions for better management and visibility.

New Contributors

• @RajashreeDahal4 made their first contribution in #379
• @anisbhsl made their first contribution in #361
• @bishwaspraveen made their first contribution in #409
• @Jmok19927 made their first contribution in #690
• @emshahh made their first contribution in #689
• @Kshaw362 made their first contribution in #691

Full Changelog: v1.1.0...v2.0.0

v1.1.0

What's Changed

• Add pytest config for vscode by @code-geek in #246
• Add code to pull in connector type by @code-geek in #252
• Deal with collections that dont have a sinequa configuration by @code-geek in #256
• Import metadata from Sinequa configs into collections on the webapp by @code-geek in #257
• Implement soft delete filtering on collection list by @code-geek in #262
• Check if pull request already exists and dont hit the create api if it does by @code-geek in #264
• Update collections fixture with latest data by @code-geek in #266
• Add django extensions to prod by @code-geek in #268
• Fix bugs in the GitHub pipeline by @code-geek in #270
• When trying to remove a title pattern by deleting it from the input box, it throws an error by @rajdangol0077 in #258

New Contributors

• @impact-github-bot made their first contribution in #239

Full Changelog: v1.0.0...v1.1.0

v1.0.0

What's Changed

• Exclude patterns by @code-geek in #25
• Feature update models by @CarsonDavis in #27
• Add machine name by @CarsonDavis in #31
• Add jupyter notebook to ingest from csv by @code-geek in #43
• Added minor features by @SauravUpadhyaya in #8
• Feature track req urls by @CarsonDavis in #62
• Feature sinequa scraper by @code-geek in #89
• Dropdown to change the status of a collection on the collection list page by @code-geek in #90
• Dropdown to change the user who is curating a collection from the collection list page by @code-geek in #91
• Dev to main by @code-geek in #93
• Remove broken fields from collection detail page by @code-geek in #95
• Bring in recently indexed collections and set the status as ready to clean by @code-geek in #101
• Turn on statesave for candidate urls table by @code-geek in #102
• Add an option to curation status by @code-geek in #104
• Refactor to Scrape by Indexing and Generate Jobs in Parallel by @CarsonDavis in #110
• API to Ingest Candidate URLs in bulk from the test server by @code-geek in #120
• API to ingest candidate urls -- improved by @code-geek in #121
• Add scripts to export the entire index by @code-geek in #123
• Add code to pull entire index from s3 by @code-geek in #126
• Remove sidebar by @code-geek in #128
• Enable stateSave and reduce the number of rows on the collection list page by @code-geek in #139
• change Curated to Visited by @code-geek in #140
• Add link to sinequa configuration on the collection detail page by @code-geek in #142
• Update code to export select collections and document processes by @code-geek in #148
• Add ability to navigate to a page with user input by @code-geek in #150
• Add link to github issue on each collection by @code-geek in #152
• Prevent moving to the top of the page when changing dropdowns by @code-geek in #156
• Avoid refreshing the page on dropdown change by @code-geek in #157
• Add a status called delete/combine collection by @rajdangol0077 in #154
• Add filter for status and allow export csv by @code-geek in #160
• Show Title Patterns in the admin by @code-geek in #164
• Add pattern type as a filter to TitlePattern admin by @code-geek in #165
• Candidate URLs page improvements by @code-geek in #167
• Change cursor to pointer when hovering on select by @code-geek in #173
• Improve DocumentTypePattern modal by @code-geek in #176
• Allow wildcards in match patterns by @code-geek in #96
• Add a searchdelay of 1000 ms by @code-geek in #185
• DataTables enhancements -- search panes and select by @code-geek in #186
• Add ranges to candidate URL search pane by @code-geek in #188
• Speed up pattern creation and add ability to deselect document type by @code-geek in #190
• Change traefik timeout to 5 minutes by @code-geek in #192
• Set curation status to "Ready to curate" when new URLs are available by @code-geek in #194
• Streamline loading candidate urls into the web app using the API by @code-geek in #203
• Add mechanism to pull in URLs from prod by @code-geek in #210
• Hide github issue link if there isn't one; Make the field editable by @rajdangol0077 in #211
• Create a models module since models.py is getting too big by @code-geek in #215
• Push generated xml to github from the web app by @code-geek in #204
• Generate XML files from patterns by @CarsonDavis in #162
• Add new status for Github_PR_Created by @code-geek in #219
• change match criteria to be surrounded by single quotes by @CarsonDavis in #231
• Make curation status update when changed by @code-geek in #235

Contributors

• @code-geek
• @CarsonDavis
• @rajdangol0077

Full Changelog: https://github.com/NASA-IMPACT/sde-indexing-helper/commits/v1.0.0