JohnSnowLabs langtest Announcements · Discussions

Sort by: Latest activity

Announcements Discussions

Updates from maintainers

You must be logged in to vote

John Snow Labs Releases LangTest 2.4.0: Introducing Multimodal VQA Testing, New Text Robustness Tests, Enhanced Multi-Label Classification, Safety Evaluation, and NER Accuracy Fixes

chakravarthik27 announced Sep 23, 2024 in Announcements

0
You must be logged in to vote

John Snow Labs releases LangTest 2.3.1: Critical Bug Fixes and Enhancements

chakravarthik27 announced Sep 12, 2024 in Announcements

0
You must be logged in to vote

John Snow Labs releases LangTest 2.3.0: Enhancing LLM Evaluation with Multi-Model, Multi-Dataset Support, Drug Name Swapping Tests, Prometheus Integration, Safety Testing, and Improved Logging

chakravarthik27 announced Jul 16, 2024 in Announcements

0
You must be logged in to vote

John Snow Labs releases LangTest 2.2.0: Advancing Language Model Testing with Model Comparison and Benchmarking, Few-Shot Evaluation, NER Evaluation for LLMs, Enhanced Data Augmentation, and Customized Multi-Dataset Prompts

chakravarthik27 announced May 15, 2024 in Announcements

0
You must be logged in to vote

John Snow Labs LangTest 2.0.0: Comprehensive Model Benchmarking, Added support for LM Studio , CLI Integration for Embedding Benchmarks, Enhanced Toxicity Tests, Multi-Dataset Comparison and elevated user experience with various bug fixes and enhancements.

ArshaanNazir announced Feb 21, 2024 in Announcements

0
You must be logged in to vote

John Snow Labs LangTest 1.10.0: Support for Evaluating RAG with LlamaIndex and Langtest, Grammar Testing, Robust Checkpoint Managememt, and Comprehensive Support for Medical Datasets (LiveQA, MedicationQA, HealthSearchQA), Direct Hugging Face Model Integration and Elevated User Experience with Numerous Bug Fixes !

ArshaanNazir announced Dec 23, 2023 in Announcements

0
You must be logged in to vote

John Snow Labs LangTest 1.9.0: Hugging Face Callback Integration, Advanced Templatic Augmentation, Comprehensive Model Benchmarking, Expanded Clinical Dataset Support (MedQA, PubMedQA, MedMCQ), Insightful Blogposts, and Enhanced User Experience with Key Bug Fixes

ArshaanNazir announced Dec 1, 2023 in Announcements

0
You must be logged in to vote

John Snow Labs LangTest 1.8.0: Codebase Refactoring, Enhanced Debugging with Error Codes, Streamlined Categorization of Tasks, Various Blogposts, Improved Open Source Community Standards and Enhanced User Experience through Multiple Bug Fixes !

ArshaanNazir announced Nov 10, 2023 in Announcements

0
You must be logged in to vote

John Snow Labs LangTest 1.7.0: Broadening Question-Answering Evaluation, Custom Model APIs, StereoSet Integration, FiQA Dataset, New BlogPosts, Gender Occupational Bias Assessment in LLMs and Enhanced User Experience through Multiple Bug Fixes !

ArshaanNazir announced Oct 24, 2023 in Announcements

0
You must be logged in to vote

John Snow Labs LangTest 1.6.0: Broadening Benchmark Horizons with CommonSenseQA, PIQA, SIQA Datasets, Unveiling Toxicity Sensitivity Test, Legal-QA Evaluations Enriched with Consumer Contracts, Privacy-Policy, Contracts-QA Datasets, Challenging Biases with Sycophancy and Crows-Pairs Stereotype Tests, and Enhanced User Experience through Multiple Bug Fixes.

ArshaanNazir announced Oct 3, 2023 in Announcements

0
You must be logged in to vote

John Snow Labs LangTest 1.5.0: Gender Stereotype Analysis with Wino-Bias, Enhancement with Legal-Support, Legal-Summarization (Multi-LexSum Dataset), Factuality & Negation-Sensitivity Tests, Updated Gender Classifier, and Streamlined Bug Resolutions for Better User Experience.

ArshaanNazir announced Sep 19, 2023 in Announcements

0
You must be logged in to vote

John Snow Labs LangTest 1.4.0 : Unveiling Political Compass & Disinformation Tests for LLMs, Inclusion of Novel Datasets (LogiQA, asdiv, Bigbench), Enhanced QA & Summarization for HF Models, Refined Codebase, Amplified Test Evaluations, and Comprehensive Bug Fixes for Optimal User Experience.

ArshaanNazir announced Sep 4, 2023 in Announcements

0
You must be logged in to vote

John Snow Labs LangTest 1.3.0: Clinical Test Support, Model & Dataset Uploading to HF, Prompt-Injection Exploration, Codebase Refinement, Enhanced Unit Test Coverage and Support for custom column names for CSV loading.

ArshaanNazir announced Aug 18, 2023 in Announcements

0
You must be logged in to vote

John Snow Labs LangTest 1.2.0: Enhancing Support for HF Dataset Augmentations, Advanced HF NER Support, Seamless End-to-End NER-HF Pipelines, Support for MLflow Metric Tracking and Performance Benchmarking with Speed Tests.

ArshaanNazir announced Aug 3, 2023 in Announcements

0
You must be logged in to vote

John Snow Labs LangTest 1.1.0: Enhancing Support for different toxicity tests, templatic augmentations, BBQ-data, HF dataset support for summarization, CSV augmentations in text classification and new robustness tests.

ArshaanNazir announced Jul 18, 2023 in Announcements

0
You must be logged in to vote

John Snow Labs - LangTest 1.0.0: An open-source library for delivering safe & effective models into production!

ArshaanNazir announced Jul 3, 2023 in Announcements

0
You must be logged in to vote

John Snow Labs NLP Test 1.5.0: Amplifying Model Comparisons, Bias Tests, Runtime Checks, Harnessing HF Datasets for Superior Text Classification and Introducing Augmentation Proportion Control

ArshaanNazir announced Jun 16, 2023 in Announcements

0
You must be logged in to vote

John Snow Labs NLP Test 1.4.0: Enhancing Support for Toxicity test and new QA benchmark datasets (NarrativeQA, TruthfulQA, QuAC, HellaSwag, MMLU and OpenbookQA)

ArshaanNazir announced Jun 6, 2023 in Announcements

0
You must be logged in to vote

John Snow Labs NLP Test 1.3.0: Enhancing Support for Evaluating Large Language Models in Summarization

ArshaanNazir announced May 25, 2023 in Announcements

0
You must be logged in to vote

John Snow Labs NLP Test 1.2.0: Announcing Support for Cohere, AI21, Azure OpenAI and Hugging Face Inference API

ArshaanNazir announced May 13, 2023 in Announcements

0
You must be logged in to vote

John Snow Labs NLP Test 1.1.0: Announcing Support for Testing LLMs

luca-martial announced May 2, 2023 in Announcements

0
You must be logged in to vote

John Snow Labs NLP Test 1.0.2: Patch Release

luca-martial announced Apr 21, 2023 in Announcements

0
You must be logged in to vote

John Snow Labs NLP Test 1.0.1: Patch Release

luca-martial announced Apr 7, 2023 in Announcements

0
You must be logged in to vote

John Snow Labs - NLP Test 1.0.0: An Open-Source Library for Delivering Safe & Effective Models into Production!

luca-martial announced Apr 3, 2023 in Announcements

0

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Filter by label

Sorry, something went wrong.

Sorry, something went wrong.

No labels found. Sorry about that.

Categories

Announcements Discussions

John Snow Labs Releases LangTest 2.4.0: Introducing Multimodal VQA Testing, New Text Robustness Tests, Enhanced Multi-Label Classification, Safety Evaluation, and NER Accuracy Fixes

John Snow Labs releases LangTest 2.3.1: Critical Bug Fixes and Enhancements

John Snow Labs releases LangTest 2.3.0: Enhancing LLM Evaluation with Multi-Model, Multi-Dataset Support, Drug Name Swapping Tests, Prometheus Integration, Safety Testing, and Improved Logging

John Snow Labs releases LangTest 2.2.0: Advancing Language Model Testing with Model Comparison and Benchmarking, Few-Shot Evaluation, NER Evaluation for LLMs, Enhanced Data Augmentation, and Customized Multi-Dataset Prompts

John Snow Labs LangTest 2.0.0: Comprehensive Model Benchmarking, Added support for LM Studio , CLI Integration for Embedding Benchmarks, Enhanced Toxicity Tests, Multi-Dataset Comparison and elevated user experience with various bug fixes and enhancements.

John Snow Labs LangTest 1.9.0: Hugging Face Callback Integration, Advanced Templatic Augmentation, Comprehensive Model Benchmarking, Expanded Clinical Dataset Support (MedQA, PubMedQA, MedMCQ), Insightful Blogposts, and Enhanced User Experience with Key Bug Fixes

John Snow Labs LangTest 1.8.0: Codebase Refactoring, Enhanced Debugging with Error Codes, Streamlined Categorization of Tasks, Various Blogposts, Improved Open Source Community Standards and Enhanced User Experience through Multiple Bug Fixes !

John Snow Labs LangTest 1.7.0: Broadening Question-Answering Evaluation, Custom Model APIs, StereoSet Integration, FiQA Dataset, New BlogPosts, Gender Occupational Bias Assessment in LLMs and Enhanced User Experience through Multiple Bug Fixes !

John Snow Labs LangTest 1.5.0: Gender Stereotype Analysis with Wino-Bias, Enhancement with Legal-Support, Legal-Summarization (Multi-LexSum Dataset), Factuality & Negation-Sensitivity Tests, Updated Gender Classifier, and Streamlined Bug Resolutions for Better User Experience.

John Snow Labs LangTest 1.4.0 : Unveiling Political Compass & Disinformation Tests for LLMs, Inclusion of Novel Datasets (LogiQA, asdiv, Bigbench), Enhanced QA & Summarization for HF Models, Refined Codebase, Amplified Test Evaluations, and Comprehensive Bug Fixes for Optimal User Experience.

John Snow Labs LangTest 1.3.0: Clinical Test Support, Model & Dataset Uploading to HF, Prompt-Injection Exploration, Codebase Refinement, Enhanced Unit Test Coverage and Support for custom column names for CSV loading.

John Snow Labs LangTest 1.2.0: Enhancing Support for HF Dataset Augmentations, Advanced HF NER Support, Seamless End-to-End NER-HF Pipelines, Support for MLflow Metric Tracking and Performance Benchmarking with Speed Tests.

John Snow Labs LangTest 1.1.0: Enhancing Support for different toxicity tests, templatic augmentations, BBQ-data, HF dataset support for summarization, CSV augmentations in text classification and new robustness tests.

John Snow Labs - LangTest 1.0.0: An open-source library for delivering safe & effective models into production!

John Snow Labs NLP Test 1.5.0: Amplifying Model Comparisons, Bias Tests, Runtime Checks, Harnessing HF Datasets for Superior Text Classification and Introducing Augmentation Proportion Control

John Snow Labs NLP Test 1.4.0: Enhancing Support for Toxicity test and new QA benchmark datasets (NarrativeQA, TruthfulQA, QuAC, HellaSwag, MMLU and OpenbookQA)

John Snow Labs NLP Test 1.3.0: Enhancing Support for Evaluating Large Language Models in Summarization

John Snow Labs NLP Test 1.2.0: Announcing Support for Cohere, AI21, Azure OpenAI and Hugging Face Inference API

John Snow Labs NLP Test 1.1.0: Announcing Support for Testing LLMs

John Snow Labs NLP Test 1.0.2: Patch Release

John Snow Labs NLP Test 1.0.1: Patch Release

John Snow Labs - NLP Test 1.0.0: An Open-Source Library for Delivering Safe & Effective Models into Production!

JohnSnowLabs langtest Announcements Discussions

Categories, most helpful, and community links

Categories

Community links

📣Announcements Discussions

Announcements Discussions