Skip to content

Issues: leondz/garak

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

281 Open 197 Closed
281 Open 197 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

stop instantiating detectors in analyze.report_digest detectors work on code that inherits from or manages Detector enhancement Architectural upgrades
#719 opened Jun 3, 2024 by leondz
octo generator loads slow generators Interfaces with LLMs quality-speed This affects the speed of program use
#716 opened Jun 3, 2024 by leondz
generators: move read timeout up to global/base.Generator config item generators Interfaces with LLMs
#715 opened May 31, 2024 by leondz
refactor detectors.dan detectors work on code that inherits from or manages Detector enhancement Architectural upgrades
#714 opened May 31, 2024 by leondz
@erickgalinkin
tests: check plugin modules for classes that aren't picked up by plugin enumeration tests Testing-related
#713 opened May 31, 2024 by leondz
remove openai_v0 plugin enhancement Architectural upgrades generators Interfaces with LLMs
#709 opened May 29, 2024 by leondz
1
probe or buff: non-standard unicode buffs Functions related to buffs (fuzzing/augmentation) new plugin Describes an entirely new probe, detector, generator or harness probes Content & activity of LLM probes
#704 opened May 28, 2024 by leondz
probe: polyglo toxicity prompts enhancement Architectural upgrades new plugin Describes an entirely new probe, detector, generator or harness probes Content & activity of LLM probes
#700 opened May 25, 2024 by leondz
reporting: update quality taxonomy & probes reporting Reporting, analysis, and other per-run result functions
#699 opened May 24, 2024 by leondz release 0.9.1
reporting: separate data and presentation reporting Reporting, analysis, and other per-run result functions
#698 opened May 24, 2024 by leondz
test: generator methods should return objects of correct type generators Interfaces with LLMs tests Testing-related
#695 opened May 23, 2024 by leondz
1
generators: openrouter generators Interfaces with LLMs new plugin Describes an entirely new probe, detector, generator or harness
#692 opened May 22, 2024 by leondz
generator: phi-3 multimodal nim generators Interfaces with LLMs new plugin Describes an entirely new probe, detector, generator or harness
#691 opened May 22, 2024 by leondz
probe: persuasive jailbreak new plugin Describes an entirely new probe, detector, generator or harness probes Content & activity of LLM probes
#683 opened May 14, 2024 by leondz
inaccurate detection results for FalseAssertion50 bug Something isn't working detectors work on code that inherits from or manages Detector
#681 opened May 13, 2024 by JKL98ISR
1
documentation: make contributing doc really clear documentation Improvements or additions to documentation
#680 opened May 13, 2024 by leondz
17 tasks
release 0.9.1
re-organise donotanswer prompts probes Content & activity of LLM probes
#676 opened May 10, 2024 by leondz
3 tasks
release 0.9.1
Deprecate print() in logic areas; enable output separation enhancement Architectural upgrades
#675 opened May 10, 2024 by leondz
8 tasks
Add "Low-resource" running mode enhancement Architectural upgrades
#674 opened May 10, 2024 by leondz
shrink docker dependencies enhancement Architectural upgrades
#673 opened May 10, 2024 by leondz
support for Metal/MPS enhancement Architectural upgrades mac OSX-specific issues
#672 opened May 10, 2024 by leondz
2 tasks
support for ROCm enhancement Architectural upgrades
#671 opened May 10, 2024 by leondz
2 tasks
generator: sensenova generators Interfaces with LLMs new plugin Describes an entirely new probe, detector, generator or harness
#666 opened May 9, 2024 by beike2020
7
run start is slow w/ no messages quality-speed This affects the speed of program use ux Interface & interaction improvements
#663 opened May 7, 2024 by leondz release 0.9.1
add ability to demonstrate unmodified vs. altered use of garak enhancement Architectural upgrades
#657 opened May 3, 2024 by leondz
ProTip! What’s not been updated in a month: updated:<2024-05-03.