Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Inbox AI extension #16084

Open
wants to merge 7 commits into
base: main
Choose a base branch
from
Open

Add Inbox AI extension #16084

wants to merge 7 commits into from

Conversation

foeken
Copy link

@foeken foeken commented Dec 29, 2024

Description

Inbox AI is a MacOS based AI automation tool. You can run AI actions with voice or image input, allowing you to automate all kinds of things and create your own voice assistants. The Inbox AI (https://inbox-ai.app) Raycast extension allows you to trigger AI actions and send along content from your browser or selected text.

  • Audio actions
  • Text actions
    • With browser content (or just URL)
    • With selected text
  • Screenshot actions
  • Attach
    • Selected content (or URL)
    • With selected text

The extension requires version 2.1 (Pending AppStore Review), if you need a copy, please let me know. Under the hood the extension simply uses the x-callback scheme Inbox AI uses and reads the plist from the app to get information on the available actions.

CleanShot 2024-12-29 at 17 50 36@2x

inbox-ai-1

Screencast

A screencast can be found on your Slack: https://raycastcommunity.slack.com/archives/C02HEMAF2SJ/p1735225581176779

Checklist

- Refactor action handling and improve code consistency: Update action filtering and sorting logic in filterActions function, enhance readability in audio and execute commands by standardizing formatting, and remove unused action titles in ActionList components. This improves overall code clarity and user experience.
- Enhance action handling in audio and execute commands: Introduce URL-only triggering option, improve error handling for active tabs and browser content retrieval, and refactor action selection logic for better user experience. Update ActionList component to support additional actions.
- Refactor browser content handling: retrieve active tab information and include it in the markdown format for audio and execute actions. This change enhances the context provided to the actions by incorporating the active tab\'s title and URL, improving the overall functionality and user experience.
- Sort filtered actions by display name in filterActions function for improved consistency in action listing.
- Update package.json to rename audio processing commands to \'Record Audio\' and screenshot command to \'Take Screenshot\' for improved clarity and consistency in action descriptions.
- Update changelog, README, and package.json; enhance audio and text processing commands with new variants and improve UI descriptions. Refactor action handling in components for consistency and clarity.
- Refactor actions: Rename \'listen\' to \'audio\', add new audio-related actions for selected text and browser content, and remove deprecated \'listen\' and \'look\' components. Update execute.tsx to streamline action handling and improve form submission logic.
- Refactor actions: Rename \'read\' to \'read_selected_text\', add \'execute\' action, and implement new components for executing actions and reading selected text. Remove deprecated \'read\' component.
- Update package.json to change icon and add \'read\' action; remove old icon file
- Add \'look\' action to package.json and refactor listen.tsx
- First working version
@raycastbot raycastbot added the new extension Label for PRs with new extensions label Dec 29, 2024
@raycastbot
Copy link
Collaborator

raycastbot commented Dec 29, 2024

Congratulations on your new Raycast extension! 🚀

You can expect an initial review within five business days.

Once the PR is approved and merged, the extension will be available on our Store.

@foeken foeken changed the title Add inbox-ai extension Add Inbox AI extension Dec 29, 2024
@pernielsentikaer
Copy link
Collaborator

I don't have any way to test this, do you have a screencast of the flow?

@pernielsentikaer pernielsentikaer self-assigned this Jan 9, 2025
@foeken
Copy link
Author

foeken commented Jan 9, 2025

Yeah, it's linked to in the original PR text :)

@foeken
Copy link
Author

foeken commented Jan 11, 2025

Did you find the video? Should I post it here?

@foeken
Copy link
Author

foeken commented Jan 11, 2025

screencast.mp4

Copy link
Collaborator

@pernielsentikaer pernielsentikaer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could we do something like Eagle to check if it's even installed?

@foeken
Copy link
Author

foeken commented Jan 12, 2025

Let me check out what they did :) It does show a nice toast that InboxAI might not be installed already I think :)

@foeken
Copy link
Author

foeken commented Jan 12, 2025

You were right, that was a nice addition. I took their example and moved it over.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
new extension Label for PRs with new extensions
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants