945d5b237c
* fix: add retry logic to sendInboxMessage for concurrent writes On Windows, parallel writes to the same inbox file cause race conditions where atomicWrite verification fails (another process overwrites between write and verify). Added retry loop (8 attempts) matching the existing pattern in addTaskComment. Bumps teamctl version to 11. Fixes CI failure: test (windows-latest) "parallel messages to same inbox" * fix: enhance CLI installer and session management - Updated the postinstall script in package.json to handle rebuild failures gracefully. - Added clearContext option in team launch requests to allow starting fresh sessions without resuming previous context. - Improved CLI installer logging by integrating raw output chunks for better terminal rendering. - Refactored components to utilize TerminalLogPanel for displaying installation logs, enhancing user experience during CLI installation. - Updated various services and hooks to support the new clearContext feature and raw logging. * fix: update MemberBadge and LaunchTeamDialog components for improved functionality - Modified MemberBadge to display 'lead' for team leads instead of the full name. - Refactored LaunchTeamDialog to simplify model selection logic and replace the Select component with a custom button-based interface for better user experience. - Enhanced KanbanTaskCard to include meta actions for task management, improving the layout and functionality for manual review tasks. * feat: auto-publish releases with stable download links - Change releaseType from draft to release for auto-publishing - Add upload-stable-links job to create version-agnostic asset copies - Update README with direct download URLs per platform - Add Requirements section to Installation - Remove downloads/platform badges - Add docs/RELEASE.md with versioning and release guide - Move community docs to .github/ * improvemtns * improvement * fix: handle Windows spawn EINVAL on non-ASCII paths and add helper utilities * improvements * fix: enhance child process environment handling for Windows - Added a helper function to build the child process environment with the correct HOME directory, addressing issues with non-ASCII usernames on Windows. - Updated CLI installer methods to utilize the new environment setup for improved compatibility and error handling. * refactor: replace execFile and spawn with execCli and spawnCli in CLI and TeamProvisioning services - Updated CliInstallerService and TeamProvisioningService to use execCli and spawnCli for improved error handling and compatibility, particularly on Windows. - Enhanced child process utility functions to better manage non-ASCII paths and provide consistent behavior across different platforms. - Adjusted tests to mock new child process utilities and verify correct usage in service methods. * fix * fix windows * feat: add download badges with direct links per platform * refactor: move download buttons to Installation section * refactor: move Docker files to docker/ and CHANGELOG to docs/ * refactor: move vite.standalone.config to docker/, remove .nvmrc * refactor: merge tsconfig.test.json into tsconfig.json * refactor: remove .editorconfig, .gitattributes, merge knip.json into package.json * fix: adjust macOS download badge sizing * feat: implement in-app project editor with CodeMirror integration - Added architectural plan and iteration plan for the in-app project editor. - Introduced new components for the editor, including CodeEditorOverlay, FileTreePanel, and EditorTabsPanel. - Established state management using Zustand for editor state persistence. - Implemented IPC channels for file operations and editor functionality. - Enhanced TeamDetailView with a button to open the editor overlay. - Conducted reuse analysis for existing components to optimize codebase integration. * feat: enhance in-app project editor with architecture documentation and service updates - Added detailed architecture and component hierarchy documentation for the in-app project editor. - Introduced `ProjectFileService` to manage file operations with improved path validation. - Updated `electron.vite.config.ts` to set `UV_THREADPOOL_SIZE` for better performance on Windows. - Deferred non-critical startup tasks in `index.ts` to avoid thread pool contention. - Enhanced `CliInstallerService` with timeout handling for status gathering to prevent UI hangs. - Added tests for `CliInstallerService` to ensure proper timeout behavior. * feat: enhance project editor with file management, Git integration, and UI improvements - Introduced `EditorFileWatcher` for live file change detection and `GitStatusService` for displaying Git status in the file tree. - Added context menu for file operations (create, delete) and implemented multi-tab support for the editor. - Enhanced user experience with keyboard shortcuts, search functionality, and breadcrumb navigation. - Updated IPC channels for file operations and integrated conflict detection during file saves. - Improved performance with file watcher optimizations and virtualized file tree rendering. * feat: enhance project editor with autosave, improved file management, and performance optimizations - Implemented draft autosave functionality to prevent data loss during crashes, with recovery options for unsaved changes. - Updated file management services to support better path validation and conflict detection. - Enhanced performance with optimized file watcher and caching strategies for project scanning. - Improved user experience with confirmation dialogs for unsaved changes and refined keyboard shortcuts. - Documented testing strategies and rollback plans for iterative development. * feat: integrate simple-git for enhanced Git status tracking and improve file watcher performance - Replaced direct Git command usage with `simple-git` for more reliable status tracking, including support for renamed files and conflict detection. - Updated IPC channels to reflect changes in Git status retrieval method. - Enhanced file watcher initialization on Windows to prevent UV thread pool saturation by starting watchers sequentially. - Improved application startup by staggering context system initialization and notification listeners to optimize performance. * feat: optimize IPC initialization and context management for improved app performance - Deferred IPC-heavy initialization to occur after the first paint to prevent app freezing on Windows. - Staggered notification listener setup to avoid saturating the UV thread pool during startup. - Updated context system initialization to be lazy, ensuring local context is always ready without upfront costs. - Enhanced data fetching sequence to reduce simultaneous IPC calls, improving overall responsiveness. * feat: enhance project editor with new error boundary and file handling improvements - Introduced `EditorErrorBoundary` component to catch runtime errors in CodeMirror, providing a fallback UI to prevent crashes. - Updated file handling logic to utilize `isbinaryfile` for more reliable binary detection, replacing manual null-byte scans. - Enhanced `openFile` method to prevent duplicate tabs for already opened files. - Improved documentation for new components and updated file lists to reflect recent changes. - Optimized file watcher and path validation processes for better performance and reliability. * feat: enhance TeamConfigReader with improved file handling and concurrency - Introduced `mapLimit` function to manage concurrent processing of team directories, optimizing performance. - Added `readFileHead` function to read the beginning of large configuration files efficiently. - Implemented `extractQuotedString` to safely extract values from JSON strings in configuration headers. - Enhanced error handling and validation for team configuration files, ensuring robust processing of team data. - Updated logic to handle large configuration files differently, improving overall reliability and performance. * feat: enhance team management with improved session and project path history handling - Introduced constants for maximum session and project path history limits to optimize memory usage. - Updated `TeamConfigReader` and `TeamProvisioningService` to limit session and project path history to defined maximums. - Enhanced `TeamMembersMetaStore` to handle large meta files more efficiently by checking file size before processing. - Refactored state management in `teamSlice` to include optimized lookups for team summaries by name and session ID. * feat: enhance GlobalTaskDetailDialog and TaskDetailDialog with loading state management - Added a loading state to the TaskDetailDialog to display a loading indicator while fetching team data. - Updated GlobalTaskDetailDialog to pass the loading state to TaskDetailDialog. - Modified the selectTeam function in teamSlice to accept options for skipping project auto-selection, improving team data handling. * feat: optimize team display name resolution and enhance file change handling - Introduced a caching mechanism for team display names to reduce redundant API calls and improve performance. - Updated file change event handling to debounce cache invalidation, preventing unnecessary rescans during rapid file changes. - Enhanced GlobalTaskDetailDialog and TaskDetailDialog to manage loading states and improve team data fetching logic. - Refactored teamSlice to streamline team selection and data loading processes. * fix: improve team selection logic and prevent duplicate fetches - Enhanced GlobalTaskDetailDialog to handle loading states more effectively, preventing unnecessary re-fetching of team data. - Updated selectTeam function in teamSlice to guard against duplicate in-flight fetches for the same team, improving performance and user experience. - Refactored dependencies in useEffect to ensure proper data loading behavior. * feat: enhance team data fetching with performance logging and timeout handling - Added performance logging to the handleGetData function, tracking the duration of team data retrieval and logging warnings for slow responses. - Implemented a timeout mechanism in the selectTeam function to prevent long-running fetch operations, improving user experience. - Enhanced the getTeamData method with detailed timing metrics for each data loading step, allowing for better performance analysis and debugging. * feat: implement timeout handling and logging for team data fetching - Added a timeout mechanism to the getBranch calls in TeamDataService to prevent hangs on Windows setups, improving reliability during team data retrieval. - Introduced performance logging in TeamDetailView and teamSlice to track the start and completion of team selection processes, enhancing debugging capabilities. - Updated error handling to provide clearer warnings during team provisioning and selection, improving user experience. * feat: enhance MarkdownViewer and task dialogs with loading state management and performance logging - Introduced character limits for Markdown content in MarkdownViewer to prevent UI freezes with large content. - Added state management for raw content display in MarkdownViewer, allowing users to expand and view large markdown files. - Implemented performance logging in GlobalTaskDetailDialog and TaskDetailDialog to track loading states and improve debugging. - Updated loading state handling in TaskDetailDialog to ensure accurate representation of loading conditions. * feat: enhance TaskCommentsSection with improved comment rendering and visibility management - Added state management for visible comments, allowing users to see a limited number of comments for better performance. - Implemented logic to cap the number of rendered comments, preventing UI freezes with large comment lists. - Introduced sorting for comments based on creation date to display the most recent comments first. - Updated the UI to inform users when only a subset of comments is being displayed, enhancing user experience. * feat: enhance MarkdownViewer with improved character limits and syntax highlighting management - Updated character limits for Markdown content to prevent UI freezes with large inputs. - Introduced logic to disable syntax highlighting for medium/large content and show raw previews for very large content. - Enhanced responsiveness of the MarkdownViewer by managing rendering based on content size. * refactor: remove console warnings from team-related components for cleaner logging - Eliminated console warnings in TeamDetailView, GlobalTaskDetailDialog, and TaskDetailDialog to streamline logging and reduce clutter during team data operations. - Updated the selectTeam function in teamSlice to remove unnecessary logging, enhancing performance and readability. * feat: add project editor with drag & drop file management - Backend: ProjectFileService with file CRUD, search, git status, file watcher - IPC: 12 editor channels with security validation and path containment - Store: editorSlice with multi-tab management, draft persistence, conflict detection - UI: CodeMirror 6 editor, file tree with DnD, search-in-files, context menus - Move: fs.rename with EXDEV fallback, full path remapping across all caches - Tests: comprehensive coverage for services, IPC handlers, store, and utilities * fix: rename closeTab/setActiveTab to closeEditorTab/setActiveEditorTab Resolve naming collision between editorSlice and tabSlice. Both slices defined closeTab and setActiveTab, and since editorSlice was spread last in the store composition, it silently overwrote the tabSlice methods, breaking tab management. * fix: editor improvements — isDir bug, scroll-to-line, Quick Open, a11y - Fix isDir heuristic: use backend-provided isDirectory instead of filename-based guessing (breaks for Makefile, .github, etc.) - Add scroll-to-line on search result click via editorPendingGoToLine - Add Cmd+Shift+W shortcut for toggling line wrap - Rewrite Quick Open to fetch all project files from backend API instead of flattening the loaded tree (limited to expanded dirs) - Fix fd leak in atomicWrite: close file handle in finally block - Add a11y: role=dialog/alert, aria-modal, aria-label on modals - Add type=button on error state buttons --------- Co-authored-by: Алексей <aleksei@example.com>
4036 lines
No EOL
140 KiB
JSON
4036 lines
No EOL
140 KiB
JSON
{
|
|
"anthropic.claude-3-5-haiku-20241022-v1:0": {
|
|
"cache_creation_input_token_cost": 0.000001,
|
|
"cache_read_input_token_cost": 8e-8,
|
|
"input_cost_per_token": 8e-7,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000004,
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true
|
|
},
|
|
"anthropic.claude-haiku-4-5-20251001-v1:0": {
|
|
"cache_creation_input_token_cost": 0.00000125,
|
|
"cache_read_input_token_cost": 1e-7,
|
|
"input_cost_per_token": 0.000001,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000005,
|
|
"source": "https://aws.amazon.com/about-aws/whats-new/2025/10/claude-4-5-haiku-anthropic-amazon-bedrock",
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346
|
|
},
|
|
"anthropic.claude-haiku-4-5@20251001": {
|
|
"cache_creation_input_token_cost": 0.00000125,
|
|
"cache_read_input_token_cost": 1e-7,
|
|
"input_cost_per_token": 0.000001,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000005,
|
|
"source": "https://aws.amazon.com/about-aws/whats-new/2025/10/claude-4-5-haiku-anthropic-amazon-bedrock",
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346,
|
|
"supports_native_streaming": true
|
|
},
|
|
"anthropic.claude-3-5-sonnet-20240620-v1:0": {
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 1000000,
|
|
"max_output_tokens": 4096,
|
|
"max_tokens": 4096,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"input_cost_per_token_above_200k_tokens": 0.000006,
|
|
"output_cost_per_token_above_200k_tokens": 0.00003,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.0000075,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6e-7,
|
|
"cache_creation_input_token_cost_above_1hr": 0.0000075,
|
|
"cache_creation_input_token_cost_above_1hr_above_200k_tokens": 0.000015,
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_read_input_token_cost": 3e-7
|
|
},
|
|
"anthropic.claude-3-5-sonnet-20241022-v2:0": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 1000000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"input_cost_per_token_above_200k_tokens": 0.000006,
|
|
"output_cost_per_token_above_200k_tokens": 0.00003,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.0000075,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6e-7,
|
|
"cache_creation_input_token_cost_above_1hr": 0.0000075,
|
|
"cache_creation_input_token_cost_above_1hr_above_200k_tokens": 0.000015
|
|
},
|
|
"anthropic.claude-3-7-sonnet-20240620-v1:0": {
|
|
"cache_creation_input_token_cost": 0.0000045,
|
|
"cache_read_input_token_cost": 3.6e-7,
|
|
"input_cost_per_token": 0.0000036,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000018,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"anthropic.claude-3-7-sonnet-20250219-v1:0": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"anthropic.claude-3-haiku-20240307-v1:0": {
|
|
"input_cost_per_token": 2.5e-7,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 4096,
|
|
"max_tokens": 4096,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.00000125,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"anthropic.claude-3-opus-20240229-v1:0": {
|
|
"input_cost_per_token": 0.000015,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 4096,
|
|
"max_tokens": 4096,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000075,
|
|
"supports_function_calling": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"anthropic.claude-3-sonnet-20240229-v1:0": {
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 4096,
|
|
"max_tokens": 4096,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"anthropic.claude-instant-v1": {
|
|
"input_cost_per_token": 8e-7,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 100000,
|
|
"max_output_tokens": 8191,
|
|
"max_tokens": 8191,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.0000024,
|
|
"supports_tool_choice": true
|
|
},
|
|
"anthropic.claude-opus-4-1-20250805-v1:0": {
|
|
"cache_creation_input_token_cost": 0.00001875,
|
|
"cache_read_input_token_cost": 0.0000015,
|
|
"input_cost_per_token": 0.000015,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 32000,
|
|
"max_tokens": 32000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000075,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"anthropic.claude-opus-4-20250514-v1:0": {
|
|
"cache_creation_input_token_cost": 0.00001875,
|
|
"cache_read_input_token_cost": 0.0000015,
|
|
"input_cost_per_token": 0.000015,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 32000,
|
|
"max_tokens": 32000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000075,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"anthropic.claude-opus-4-5-20251101-v1:0": {
|
|
"cache_creation_input_token_cost": 0.00000625,
|
|
"cache_read_input_token_cost": 5e-7,
|
|
"input_cost_per_token": 0.000005,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000025,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"anthropic.claude-opus-4-6-v1": {
|
|
"cache_creation_input_token_cost": 0.00000625,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.0000125,
|
|
"cache_read_input_token_cost": 5e-7,
|
|
"cache_read_input_token_cost_above_200k_tokens": 0.000001,
|
|
"input_cost_per_token": 0.000005,
|
|
"input_cost_per_token_above_200k_tokens": 0.00001,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 1000000,
|
|
"max_output_tokens": 128000,
|
|
"max_tokens": 128000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000025,
|
|
"output_cost_per_token_above_200k_tokens": 0.0000375,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": false,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346
|
|
},
|
|
"global.anthropic.claude-opus-4-6-v1": {
|
|
"cache_creation_input_token_cost": 0.00000625,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.0000125,
|
|
"cache_read_input_token_cost": 5e-7,
|
|
"cache_read_input_token_cost_above_200k_tokens": 0.000001,
|
|
"input_cost_per_token": 0.000005,
|
|
"input_cost_per_token_above_200k_tokens": 0.00001,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 1000000,
|
|
"max_output_tokens": 128000,
|
|
"max_tokens": 128000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000025,
|
|
"output_cost_per_token_above_200k_tokens": 0.0000375,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": false,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346
|
|
},
|
|
"us.anthropic.claude-opus-4-6-v1": {
|
|
"cache_creation_input_token_cost": 0.000006875,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.00001375,
|
|
"cache_read_input_token_cost": 5.5e-7,
|
|
"cache_read_input_token_cost_above_200k_tokens": 0.0000011,
|
|
"input_cost_per_token": 0.0000055,
|
|
"input_cost_per_token_above_200k_tokens": 0.000011,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 1000000,
|
|
"max_output_tokens": 128000,
|
|
"max_tokens": 128000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.0000275,
|
|
"output_cost_per_token_above_200k_tokens": 0.00004125,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": false,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346
|
|
},
|
|
"eu.anthropic.claude-opus-4-6-v1": {
|
|
"cache_creation_input_token_cost": 0.000006875,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.00001375,
|
|
"cache_read_input_token_cost": 5.5e-7,
|
|
"cache_read_input_token_cost_above_200k_tokens": 0.0000011,
|
|
"input_cost_per_token": 0.0000055,
|
|
"input_cost_per_token_above_200k_tokens": 0.000011,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 1000000,
|
|
"max_output_tokens": 128000,
|
|
"max_tokens": 128000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.0000275,
|
|
"output_cost_per_token_above_200k_tokens": 0.00004125,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": false,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346
|
|
},
|
|
"au.anthropic.claude-opus-4-6-v1": {
|
|
"cache_creation_input_token_cost": 0.000006875,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.00001375,
|
|
"cache_read_input_token_cost": 5.5e-7,
|
|
"cache_read_input_token_cost_above_200k_tokens": 0.0000011,
|
|
"input_cost_per_token": 0.0000055,
|
|
"input_cost_per_token_above_200k_tokens": 0.000011,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 1000000,
|
|
"max_output_tokens": 128000,
|
|
"max_tokens": 128000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.0000275,
|
|
"output_cost_per_token_above_200k_tokens": 0.00004125,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": false,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346
|
|
},
|
|
"anthropic.claude-sonnet-4-6": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.0000075,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"input_cost_per_token_above_200k_tokens": 0.000006,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"output_cost_per_token_above_200k_tokens": 0.0000225,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346
|
|
},
|
|
"global.anthropic.claude-sonnet-4-6": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.0000075,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"input_cost_per_token_above_200k_tokens": 0.000006,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"output_cost_per_token_above_200k_tokens": 0.0000225,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346
|
|
},
|
|
"us.anthropic.claude-sonnet-4-6": {
|
|
"cache_creation_input_token_cost": 0.000004125,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.00000825,
|
|
"cache_read_input_token_cost": 3.3e-7,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6.6e-7,
|
|
"input_cost_per_token": 0.0000033,
|
|
"input_cost_per_token_above_200k_tokens": 0.0000066,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.0000165,
|
|
"output_cost_per_token_above_200k_tokens": 0.00002475,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346
|
|
},
|
|
"eu.anthropic.claude-sonnet-4-6": {
|
|
"cache_creation_input_token_cost": 0.000004125,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.00000825,
|
|
"cache_read_input_token_cost": 3.3e-7,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6.6e-7,
|
|
"input_cost_per_token": 0.0000033,
|
|
"input_cost_per_token_above_200k_tokens": 0.0000066,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.0000165,
|
|
"output_cost_per_token_above_200k_tokens": 0.00002475,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346
|
|
},
|
|
"apac.anthropic.claude-sonnet-4-6": {
|
|
"cache_creation_input_token_cost": 0.000004125,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.00000825,
|
|
"cache_read_input_token_cost": 3.3e-7,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6.6e-7,
|
|
"input_cost_per_token": 0.0000033,
|
|
"input_cost_per_token_above_200k_tokens": 0.0000066,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.0000165,
|
|
"output_cost_per_token_above_200k_tokens": 0.00002475,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346
|
|
},
|
|
"anthropic.claude-sonnet-4-20250514-v1:0": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"input_cost_per_token_above_200k_tokens": 0.000006,
|
|
"output_cost_per_token_above_200k_tokens": 0.0000225,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.0000075,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6e-7,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 1000000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"anthropic.claude-sonnet-4-5-20250929-v1:0": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"input_cost_per_token_above_200k_tokens": 0.000006,
|
|
"output_cost_per_token_above_200k_tokens": 0.0000225,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.0000075,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6e-7,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"anthropic.claude-v1": {
|
|
"input_cost_per_token": 0.000008,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 100000,
|
|
"max_output_tokens": 8191,
|
|
"max_tokens": 8191,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000024
|
|
},
|
|
"anthropic.claude-v2:1": {
|
|
"input_cost_per_token": 0.000008,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 100000,
|
|
"max_output_tokens": 8191,
|
|
"max_tokens": 8191,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000024,
|
|
"supports_tool_choice": true
|
|
},
|
|
"apac.anthropic.claude-3-5-sonnet-20240620-v1:0": {
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 4096,
|
|
"max_tokens": 4096,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"apac.anthropic.claude-3-5-sonnet-20241022-v2:0": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"apac.anthropic.claude-3-haiku-20240307-v1:0": {
|
|
"input_cost_per_token": 2.5e-7,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 4096,
|
|
"max_tokens": 4096,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.00000125,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"apac.anthropic.claude-haiku-4-5-20251001-v1:0": {
|
|
"cache_creation_input_token_cost": 0.000001375,
|
|
"cache_read_input_token_cost": 1.1e-7,
|
|
"input_cost_per_token": 0.0000011,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.0000055,
|
|
"source": "https://aws.amazon.com/about-aws/whats-new/2025/10/claude-4-5-haiku-anthropic-amazon-bedrock",
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346
|
|
},
|
|
"apac.anthropic.claude-3-sonnet-20240229-v1:0": {
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 4096,
|
|
"max_tokens": 4096,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"apac.anthropic.claude-sonnet-4-20250514-v1:0": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"input_cost_per_token_above_200k_tokens": 0.000006,
|
|
"output_cost_per_token_above_200k_tokens": 0.0000225,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.0000075,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6e-7,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 1000000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"au.anthropic.claude-sonnet-4-5-20250929-v1:0": {
|
|
"cache_creation_input_token_cost": 0.000004125,
|
|
"cache_read_input_token_cost": 3.3e-7,
|
|
"input_cost_per_token": 0.0000033,
|
|
"input_cost_per_token_above_200k_tokens": 0.0000066,
|
|
"output_cost_per_token_above_200k_tokens": 0.00002475,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.00000825,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6.6e-7,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.0000165,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346
|
|
},
|
|
"azure_ai/claude-haiku-4-5": {
|
|
"cache_creation_input_token_cost": 0.00000125,
|
|
"cache_creation_input_token_cost_above_1hr": 0.000002,
|
|
"cache_read_input_token_cost": 1e-7,
|
|
"input_cost_per_token": 0.000001,
|
|
"litellm_provider": "azure_ai",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000005,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"azure_ai/claude-opus-4-5": {
|
|
"cache_creation_input_token_cost": 0.00000625,
|
|
"cache_creation_input_token_cost_above_1hr": 0.00001,
|
|
"cache_read_input_token_cost": 5e-7,
|
|
"input_cost_per_token": 0.000005,
|
|
"litellm_provider": "azure_ai",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000025,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"azure_ai/claude-opus-4-6": {
|
|
"input_cost_per_token": 0.000005,
|
|
"output_cost_per_token": 0.000025,
|
|
"litellm_provider": "azure_ai",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 128000,
|
|
"max_tokens": 128000,
|
|
"mode": "chat",
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"cache_creation_input_token_cost": 0.00000625,
|
|
"cache_creation_input_token_cost_above_1hr": 0.00001,
|
|
"cache_read_input_token_cost": 5e-7,
|
|
"supports_assistant_prefill": false,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"azure_ai/claude-opus-4-1": {
|
|
"cache_creation_input_token_cost": 0.00001875,
|
|
"cache_creation_input_token_cost_above_1hr": 0.00003,
|
|
"cache_read_input_token_cost": 0.0000015,
|
|
"input_cost_per_token": 0.000015,
|
|
"litellm_provider": "azure_ai",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 32000,
|
|
"max_tokens": 32000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000075,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"azure_ai/claude-sonnet-4-5": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_creation_input_token_cost_above_1hr": 0.000006,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "azure_ai",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"azure_ai/claude-sonnet-4-6": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_creation_input_token_cost_above_1hr": 0.000006,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "azure_ai",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346
|
|
},
|
|
"bedrock/ap-northeast-1/anthropic.claude-instant-v1": {
|
|
"input_cost_per_token": 0.00000223,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 100000,
|
|
"max_output_tokens": 8191,
|
|
"max_tokens": 8191,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.00000755,
|
|
"supports_tool_choice": true
|
|
},
|
|
"bedrock/ap-northeast-1/anthropic.claude-v1": {
|
|
"input_cost_per_token": 0.000008,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 100000,
|
|
"max_output_tokens": 8191,
|
|
"max_tokens": 8191,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000024,
|
|
"supports_tool_choice": true
|
|
},
|
|
"bedrock/ap-northeast-1/anthropic.claude-v2:1": {
|
|
"input_cost_per_token": 0.000008,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 100000,
|
|
"max_output_tokens": 8191,
|
|
"max_tokens": 8191,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000024,
|
|
"supports_tool_choice": true
|
|
},
|
|
"bedrock/eu-central-1/anthropic.claude-instant-v1": {
|
|
"input_cost_per_token": 0.00000248,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 100000,
|
|
"max_output_tokens": 8191,
|
|
"max_tokens": 8191,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.00000838,
|
|
"supports_tool_choice": true
|
|
},
|
|
"bedrock/eu-central-1/anthropic.claude-v1": {
|
|
"input_cost_per_token": 0.000008,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 100000,
|
|
"max_output_tokens": 8191,
|
|
"max_tokens": 8191,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000024
|
|
},
|
|
"bedrock/eu-central-1/anthropic.claude-v2:1": {
|
|
"input_cost_per_token": 0.000008,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 100000,
|
|
"max_output_tokens": 8191,
|
|
"max_tokens": 8191,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000024,
|
|
"supports_tool_choice": true
|
|
},
|
|
"bedrock/invoke/anthropic.claude-3-5-sonnet-20240620-v1:0": {
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 4096,
|
|
"max_tokens": 4096,
|
|
"metadata": {
|
|
"notes": "Anthropic via Invoke route does not currently support pdf input."
|
|
},
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_function_calling": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"bedrock/us-east-1/anthropic.claude-instant-v1": {
|
|
"input_cost_per_token": 8e-7,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 100000,
|
|
"max_output_tokens": 8191,
|
|
"max_tokens": 8191,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.0000024,
|
|
"supports_tool_choice": true
|
|
},
|
|
"bedrock/us-east-1/anthropic.claude-v1": {
|
|
"input_cost_per_token": 0.000008,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 100000,
|
|
"max_output_tokens": 8191,
|
|
"max_tokens": 8191,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000024,
|
|
"supports_tool_choice": true
|
|
},
|
|
"bedrock/us-east-1/anthropic.claude-v2:1": {
|
|
"input_cost_per_token": 0.000008,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 100000,
|
|
"max_output_tokens": 8191,
|
|
"max_tokens": 8191,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000024,
|
|
"supports_tool_choice": true
|
|
},
|
|
"bedrock/us-gov-east-1/anthropic.claude-3-5-sonnet-20240620-v1:0": {
|
|
"input_cost_per_token": 0.0000036,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000018,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"bedrock/us-gov-east-1/anthropic.claude-3-haiku-20240307-v1:0": {
|
|
"input_cost_per_token": 3e-7,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 4096,
|
|
"max_tokens": 4096,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.0000015,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"bedrock/us-gov-east-1/claude-sonnet-4-5-20250929-v1:0": {
|
|
"input_cost_per_token": 0.0000033,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 4096,
|
|
"max_tokens": 4096,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.0000165,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"bedrock/us-gov-west-1/anthropic.claude-3-7-sonnet-20250219-v1:0": {
|
|
"cache_creation_input_token_cost": 0.0000045,
|
|
"cache_read_input_token_cost": 3.6e-7,
|
|
"input_cost_per_token": 0.0000036,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000018,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"bedrock/us-gov-west-1/anthropic.claude-3-5-sonnet-20240620-v1:0": {
|
|
"input_cost_per_token": 0.0000036,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000018,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"bedrock/us-gov-west-1/anthropic.claude-3-haiku-20240307-v1:0": {
|
|
"input_cost_per_token": 3e-7,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 4096,
|
|
"max_tokens": 4096,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.0000015,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"bedrock/us-gov-west-1/claude-sonnet-4-5-20250929-v1:0": {
|
|
"input_cost_per_token": 0.0000033,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 4096,
|
|
"max_tokens": 4096,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.0000165,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"bedrock/us-west-2/anthropic.claude-instant-v1": {
|
|
"input_cost_per_token": 8e-7,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 100000,
|
|
"max_output_tokens": 8191,
|
|
"max_tokens": 8191,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.0000024,
|
|
"supports_tool_choice": true
|
|
},
|
|
"bedrock/us-west-2/anthropic.claude-v1": {
|
|
"input_cost_per_token": 0.000008,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 100000,
|
|
"max_output_tokens": 8191,
|
|
"max_tokens": 8191,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000024,
|
|
"supports_tool_choice": true
|
|
},
|
|
"bedrock/us-west-2/anthropic.claude-v2:1": {
|
|
"input_cost_per_token": 0.000008,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 100000,
|
|
"max_output_tokens": 8191,
|
|
"max_tokens": 8191,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000024,
|
|
"supports_tool_choice": true
|
|
},
|
|
"bedrock/us.anthropic.claude-3-5-haiku-20241022-v1:0": {
|
|
"cache_creation_input_token_cost": 0.000001,
|
|
"cache_read_input_token_cost": 8e-8,
|
|
"input_cost_per_token": 8e-7,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000004,
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true
|
|
},
|
|
"claude-3-5-haiku-20241022": {
|
|
"cache_creation_input_token_cost": 0.000001,
|
|
"cache_creation_input_token_cost_above_1hr": 0.000006,
|
|
"cache_read_input_token_cost": 8e-8,
|
|
"deprecation_date": "2025-10-01",
|
|
"input_cost_per_token": 8e-7,
|
|
"litellm_provider": "anthropic",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000004,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"supports_web_search": true,
|
|
"tool_use_system_prompt_tokens": 264
|
|
},
|
|
"claude-3-5-haiku-latest": {
|
|
"cache_creation_input_token_cost": 0.00000125,
|
|
"cache_creation_input_token_cost_above_1hr": 0.000006,
|
|
"cache_read_input_token_cost": 1e-7,
|
|
"deprecation_date": "2025-10-01",
|
|
"input_cost_per_token": 0.000001,
|
|
"litellm_provider": "anthropic",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000005,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"supports_web_search": true,
|
|
"tool_use_system_prompt_tokens": 264
|
|
},
|
|
"claude-haiku-4-5-20251001": {
|
|
"cache_creation_input_token_cost": 0.00000125,
|
|
"cache_creation_input_token_cost_above_1hr": 0.000002,
|
|
"cache_read_input_token_cost": 1e-7,
|
|
"input_cost_per_token": 0.000001,
|
|
"litellm_provider": "anthropic",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000005,
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_computer_use": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"claude-haiku-4-5": {
|
|
"cache_creation_input_token_cost": 0.00000125,
|
|
"cache_creation_input_token_cost_above_1hr": 0.000002,
|
|
"cache_read_input_token_cost": 1e-7,
|
|
"input_cost_per_token": 0.000001,
|
|
"litellm_provider": "anthropic",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000005,
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_computer_use": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"claude-3-5-sonnet-20240620": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_creation_input_token_cost_above_1hr": 0.000006,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"deprecation_date": "2025-06-01",
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "anthropic",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"claude-3-5-sonnet-20241022": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_creation_input_token_cost_above_1hr": 0.000006,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"deprecation_date": "2025-10-01",
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "anthropic",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"supports_web_search": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"claude-3-5-sonnet-latest": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_creation_input_token_cost_above_1hr": 0.000006,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"deprecation_date": "2025-06-01",
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "anthropic",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"supports_web_search": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"claude-3-7-sonnet-20250219": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_creation_input_token_cost_above_1hr": 0.000006,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"deprecation_date": "2026-02-19",
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "anthropic",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"supports_web_search": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"claude-3-7-sonnet-latest": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_creation_input_token_cost_above_1hr": 0.000006,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"deprecation_date": "2025-06-01",
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "anthropic",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"claude-3-haiku-20240307": {
|
|
"cache_creation_input_token_cost": 3e-7,
|
|
"cache_creation_input_token_cost_above_1hr": 0.000006,
|
|
"cache_read_input_token_cost": 3e-8,
|
|
"input_cost_per_token": 2.5e-7,
|
|
"litellm_provider": "anthropic",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 4096,
|
|
"max_tokens": 4096,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.00000125,
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 264
|
|
},
|
|
"claude-3-opus-20240229": {
|
|
"cache_creation_input_token_cost": 0.00001875,
|
|
"cache_creation_input_token_cost_above_1hr": 0.000006,
|
|
"cache_read_input_token_cost": 0.0000015,
|
|
"deprecation_date": "2026-05-01",
|
|
"input_cost_per_token": 0.000015,
|
|
"litellm_provider": "anthropic",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 4096,
|
|
"max_tokens": 4096,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000075,
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 395
|
|
},
|
|
"claude-3-opus-latest": {
|
|
"cache_creation_input_token_cost": 0.00001875,
|
|
"cache_creation_input_token_cost_above_1hr": 0.000006,
|
|
"cache_read_input_token_cost": 0.0000015,
|
|
"deprecation_date": "2025-03-01",
|
|
"input_cost_per_token": 0.000015,
|
|
"litellm_provider": "anthropic",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 4096,
|
|
"max_tokens": 4096,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000075,
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 395
|
|
},
|
|
"claude-4-opus-20250514": {
|
|
"cache_creation_input_token_cost": 0.00001875,
|
|
"cache_read_input_token_cost": 0.0000015,
|
|
"input_cost_per_token": 0.000015,
|
|
"litellm_provider": "anthropic",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 32000,
|
|
"max_tokens": 32000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000075,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"claude-4-sonnet-20250514": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.0000075,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"input_cost_per_token_above_200k_tokens": 0.000006,
|
|
"litellm_provider": "anthropic",
|
|
"max_input_tokens": 1000000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"output_cost_per_token_above_200k_tokens": 0.0000225,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"supports_web_search": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"claude-sonnet-4-5": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"input_cost_per_token_above_200k_tokens": 0.000006,
|
|
"output_cost_per_token_above_200k_tokens": 0.0000225,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.0000075,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6e-7,
|
|
"litellm_provider": "anthropic",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346
|
|
},
|
|
"claude-sonnet-4-5-20250929": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"input_cost_per_token_above_200k_tokens": 0.000006,
|
|
"output_cost_per_token_above_200k_tokens": 0.0000225,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.0000075,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6e-7,
|
|
"litellm_provider": "anthropic",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"supports_web_search": true,
|
|
"tool_use_system_prompt_tokens": 346
|
|
},
|
|
"claude-sonnet-4-6": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.0000075,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"input_cost_per_token_above_200k_tokens": 0.000006,
|
|
"litellm_provider": "anthropic",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"output_cost_per_token_above_200k_tokens": 0.0000225,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346
|
|
},
|
|
"claude-sonnet-4-5-20250929-v1:0": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"input_cost_per_token_above_200k_tokens": 0.000006,
|
|
"output_cost_per_token_above_200k_tokens": 0.0000225,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.0000075,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6e-7,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"claude-opus-4-1": {
|
|
"cache_creation_input_token_cost": 0.00001875,
|
|
"cache_creation_input_token_cost_above_1hr": 0.00003,
|
|
"cache_read_input_token_cost": 0.0000015,
|
|
"input_cost_per_token": 0.000015,
|
|
"litellm_provider": "anthropic",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 32000,
|
|
"max_tokens": 32000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000075,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"claude-opus-4-1-20250805": {
|
|
"cache_creation_input_token_cost": 0.00001875,
|
|
"cache_creation_input_token_cost_above_1hr": 0.00003,
|
|
"cache_read_input_token_cost": 0.0000015,
|
|
"input_cost_per_token": 0.000015,
|
|
"deprecation_date": "2026-08-05",
|
|
"litellm_provider": "anthropic",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 32000,
|
|
"max_tokens": 32000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000075,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"claude-opus-4-20250514": {
|
|
"cache_creation_input_token_cost": 0.00001875,
|
|
"cache_creation_input_token_cost_above_1hr": 0.00003,
|
|
"cache_read_input_token_cost": 0.0000015,
|
|
"input_cost_per_token": 0.000015,
|
|
"deprecation_date": "2026-05-14",
|
|
"litellm_provider": "anthropic",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 32000,
|
|
"max_tokens": 32000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000075,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"claude-opus-4-5-20251101": {
|
|
"cache_creation_input_token_cost": 0.00000625,
|
|
"cache_creation_input_token_cost_above_1hr": 0.00001,
|
|
"cache_read_input_token_cost": 5e-7,
|
|
"input_cost_per_token": 0.000005,
|
|
"litellm_provider": "anthropic",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000025,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"claude-opus-4-5": {
|
|
"cache_creation_input_token_cost": 0.00000625,
|
|
"cache_creation_input_token_cost_above_1hr": 0.00001,
|
|
"cache_read_input_token_cost": 5e-7,
|
|
"input_cost_per_token": 0.000005,
|
|
"litellm_provider": "anthropic",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000025,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"claude-opus-4-6": {
|
|
"cache_creation_input_token_cost": 0.00000625,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.0000125,
|
|
"cache_creation_input_token_cost_above_1hr": 0.00001,
|
|
"cache_read_input_token_cost": 5e-7,
|
|
"cache_read_input_token_cost_above_200k_tokens": 0.000001,
|
|
"input_cost_per_token": 0.000005,
|
|
"input_cost_per_token_above_200k_tokens": 0.00001,
|
|
"litellm_provider": "anthropic",
|
|
"max_input_tokens": 1000000,
|
|
"max_output_tokens": 128000,
|
|
"max_tokens": 128000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000025,
|
|
"output_cost_per_token_above_200k_tokens": 0.0000375,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": false,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346,
|
|
"provider_specific_entry": {
|
|
"us": 1.1,
|
|
"fast": 6
|
|
}
|
|
},
|
|
"claude-opus-4-6-20260205": {
|
|
"cache_creation_input_token_cost": 0.00000625,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.0000125,
|
|
"cache_creation_input_token_cost_above_1hr": 0.00001,
|
|
"cache_read_input_token_cost": 5e-7,
|
|
"cache_read_input_token_cost_above_200k_tokens": 0.000001,
|
|
"input_cost_per_token": 0.000005,
|
|
"input_cost_per_token_above_200k_tokens": 0.00001,
|
|
"litellm_provider": "anthropic",
|
|
"max_input_tokens": 1000000,
|
|
"max_output_tokens": 128000,
|
|
"max_tokens": 128000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000025,
|
|
"output_cost_per_token_above_200k_tokens": 0.0000375,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": false,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346,
|
|
"provider_specific_entry": {
|
|
"us": 1.1,
|
|
"fast": 6
|
|
}
|
|
},
|
|
"claude-sonnet-4-20250514": {
|
|
"deprecation_date": "2026-05-14",
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_creation_input_token_cost_above_1hr": 0.000006,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"input_cost_per_token_above_200k_tokens": 0.000006,
|
|
"output_cost_per_token_above_200k_tokens": 0.0000225,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.0000075,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6e-7,
|
|
"litellm_provider": "anthropic",
|
|
"max_input_tokens": 1000000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"databricks/databricks-claude-3-7-sonnet": {
|
|
"input_cost_per_token": 0.0000029999900000000002,
|
|
"input_dbu_cost_per_token": 0.000042857,
|
|
"litellm_provider": "databricks",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 128000,
|
|
"max_tokens": 128000,
|
|
"metadata": {
|
|
"notes": "Input/output cost per token is dbu cost * $0.070. Number provided for reference, '*_dbu_cost_per_token' used in actual calculation."
|
|
},
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015000020000000002,
|
|
"output_dbu_cost_per_token": 0.000214286,
|
|
"source": "https://www.databricks.com/product/pricing/proprietary-foundation-model-serving",
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_reasoning": true,
|
|
"supports_tool_choice": true
|
|
},
|
|
"databricks/databricks-claude-haiku-4-5": {
|
|
"input_cost_per_token": 0.00000100002,
|
|
"input_dbu_cost_per_token": 0.000014286,
|
|
"litellm_provider": "databricks",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"metadata": {
|
|
"notes": "Input/output cost per token is dbu cost * $0.070. Number provided for reference, '*_dbu_cost_per_token' used in actual calculation."
|
|
},
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.00000500003,
|
|
"output_dbu_cost_per_token": 0.000071429,
|
|
"source": "https://www.databricks.com/product/pricing/proprietary-foundation-model-serving",
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_reasoning": true,
|
|
"supports_tool_choice": true
|
|
},
|
|
"databricks/databricks-claude-opus-4": {
|
|
"input_cost_per_token": 0.000015000020000000002,
|
|
"input_dbu_cost_per_token": 0.000214286,
|
|
"litellm_provider": "databricks",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 32000,
|
|
"max_tokens": 32000,
|
|
"metadata": {
|
|
"notes": "Input/output cost per token is dbu cost * $0.070. Number provided for reference, '*_dbu_cost_per_token' used in actual calculation."
|
|
},
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.00007500003000000001,
|
|
"output_dbu_cost_per_token": 0.001071429,
|
|
"source": "https://www.databricks.com/product/pricing/proprietary-foundation-model-serving",
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_reasoning": true,
|
|
"supports_tool_choice": true
|
|
},
|
|
"databricks/databricks-claude-opus-4-1": {
|
|
"input_cost_per_token": 0.000015000020000000002,
|
|
"input_dbu_cost_per_token": 0.000214286,
|
|
"litellm_provider": "databricks",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 32000,
|
|
"max_tokens": 32000,
|
|
"metadata": {
|
|
"notes": "Input/output cost per token is dbu cost * $0.070. Number provided for reference, '*_dbu_cost_per_token' used in actual calculation."
|
|
},
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.00007500003000000001,
|
|
"output_dbu_cost_per_token": 0.001071429,
|
|
"source": "https://www.databricks.com/product/pricing/proprietary-foundation-model-serving",
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_reasoning": true,
|
|
"supports_tool_choice": true
|
|
},
|
|
"databricks/databricks-claude-opus-4-5": {
|
|
"input_cost_per_token": 0.00000500003,
|
|
"input_dbu_cost_per_token": 0.000071429,
|
|
"litellm_provider": "databricks",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"metadata": {
|
|
"notes": "Input/output cost per token is dbu cost * $0.070. Number provided for reference, '*_dbu_cost_per_token' used in actual calculation."
|
|
},
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000025000010000000002,
|
|
"output_dbu_cost_per_token": 0.000357143,
|
|
"source": "https://www.databricks.com/product/pricing/proprietary-foundation-model-serving",
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_reasoning": true,
|
|
"supports_tool_choice": true
|
|
},
|
|
"databricks/databricks-claude-sonnet-4": {
|
|
"input_cost_per_token": 0.0000029999900000000002,
|
|
"input_dbu_cost_per_token": 0.000042857,
|
|
"litellm_provider": "databricks",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"metadata": {
|
|
"notes": "Input/output cost per token is dbu cost * $0.070. Number provided for reference, '*_dbu_cost_per_token' used in actual calculation."
|
|
},
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015000020000000002,
|
|
"output_dbu_cost_per_token": 0.000214286,
|
|
"source": "https://www.databricks.com/product/pricing/proprietary-foundation-model-serving",
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_reasoning": true,
|
|
"supports_tool_choice": true
|
|
},
|
|
"databricks/databricks-claude-sonnet-4-1": {
|
|
"input_cost_per_token": 0.0000029999900000000002,
|
|
"input_dbu_cost_per_token": 0.000042857,
|
|
"litellm_provider": "databricks",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"metadata": {
|
|
"notes": "Input/output cost per token is dbu cost * $0.070. Number provided for reference, '*_dbu_cost_per_token' used in actual calculation."
|
|
},
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015000020000000002,
|
|
"output_dbu_cost_per_token": 0.000214286,
|
|
"source": "https://www.databricks.com/product/pricing/proprietary-foundation-model-serving",
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_reasoning": true,
|
|
"supports_tool_choice": true
|
|
},
|
|
"databricks/databricks-claude-sonnet-4-5": {
|
|
"input_cost_per_token": 0.0000029999900000000002,
|
|
"input_dbu_cost_per_token": 0.000042857,
|
|
"litellm_provider": "databricks",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"metadata": {
|
|
"notes": "Input/output cost per token is dbu cost * $0.070. Number provided for reference, '*_dbu_cost_per_token' used in actual calculation."
|
|
},
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015000020000000002,
|
|
"output_dbu_cost_per_token": 0.000214286,
|
|
"source": "https://www.databricks.com/product/pricing/proprietary-foundation-model-serving",
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_reasoning": true,
|
|
"supports_tool_choice": true
|
|
},
|
|
"deepinfra/anthropic/claude-3-7-sonnet-latest": {
|
|
"max_tokens": 200000,
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 200000,
|
|
"input_cost_per_token": 0.0000033,
|
|
"output_cost_per_token": 0.0000165,
|
|
"cache_read_input_token_cost": 3.3e-7,
|
|
"litellm_provider": "deepinfra",
|
|
"mode": "chat",
|
|
"supports_tool_choice": true
|
|
},
|
|
"deepinfra/anthropic/claude-4-opus": {
|
|
"max_tokens": 200000,
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 200000,
|
|
"input_cost_per_token": 0.0000165,
|
|
"output_cost_per_token": 0.0000825,
|
|
"litellm_provider": "deepinfra",
|
|
"mode": "chat",
|
|
"supports_tool_choice": true
|
|
},
|
|
"deepinfra/anthropic/claude-4-sonnet": {
|
|
"max_tokens": 200000,
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 200000,
|
|
"input_cost_per_token": 0.0000033,
|
|
"output_cost_per_token": 0.0000165,
|
|
"litellm_provider": "deepinfra",
|
|
"mode": "chat",
|
|
"supports_tool_choice": true
|
|
},
|
|
"eu.anthropic.claude-3-5-haiku-20241022-v1:0": {
|
|
"input_cost_per_token": 2.5e-7,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.00000125,
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true
|
|
},
|
|
"eu.anthropic.claude-haiku-4-5-20251001-v1:0": {
|
|
"cache_creation_input_token_cost": 0.000001375,
|
|
"cache_read_input_token_cost": 1.1e-7,
|
|
"input_cost_per_token": 0.0000011,
|
|
"deprecation_date": "2026-10-15",
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.0000055,
|
|
"source": "https://aws.amazon.com/about-aws/whats-new/2025/10/claude-4-5-haiku-anthropic-amazon-bedrock",
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346
|
|
},
|
|
"eu.anthropic.claude-3-5-sonnet-20240620-v1:0": {
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 4096,
|
|
"max_tokens": 4096,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"eu.anthropic.claude-3-5-sonnet-20241022-v2:0": {
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"eu.anthropic.claude-3-7-sonnet-20250219-v1:0": {
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"eu.anthropic.claude-3-haiku-20240307-v1:0": {
|
|
"input_cost_per_token": 2.5e-7,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 4096,
|
|
"max_tokens": 4096,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.00000125,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"eu.anthropic.claude-3-opus-20240229-v1:0": {
|
|
"input_cost_per_token": 0.000015,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 4096,
|
|
"max_tokens": 4096,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000075,
|
|
"supports_function_calling": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"eu.anthropic.claude-3-sonnet-20240229-v1:0": {
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 4096,
|
|
"max_tokens": 4096,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"eu.anthropic.claude-opus-4-1-20250805-v1:0": {
|
|
"cache_creation_input_token_cost": 0.00001875,
|
|
"cache_read_input_token_cost": 0.0000015,
|
|
"input_cost_per_token": 0.000015,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 32000,
|
|
"max_tokens": 32000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000075,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"eu.anthropic.claude-opus-4-20250514-v1:0": {
|
|
"cache_creation_input_token_cost": 0.00001875,
|
|
"cache_read_input_token_cost": 0.0000015,
|
|
"input_cost_per_token": 0.000015,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 32000,
|
|
"max_tokens": 32000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000075,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"eu.anthropic.claude-sonnet-4-20250514-v1:0": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"input_cost_per_token_above_200k_tokens": 0.000006,
|
|
"output_cost_per_token_above_200k_tokens": 0.0000225,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.0000075,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6e-7,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 1000000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"eu.anthropic.claude-sonnet-4-5-20250929-v1:0": {
|
|
"cache_creation_input_token_cost": 0.000004125,
|
|
"cache_read_input_token_cost": 3.3e-7,
|
|
"input_cost_per_token": 0.0000033,
|
|
"input_cost_per_token_above_200k_tokens": 0.0000066,
|
|
"output_cost_per_token_above_200k_tokens": 0.00002475,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.00000825,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6.6e-7,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.0000165,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346
|
|
},
|
|
"gmi/anthropic/claude-opus-4.5": {
|
|
"input_cost_per_token": 0.000005,
|
|
"litellm_provider": "gmi",
|
|
"max_input_tokens": 409600,
|
|
"max_output_tokens": 32000,
|
|
"max_tokens": 32000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000025,
|
|
"supports_function_calling": true,
|
|
"supports_vision": true
|
|
},
|
|
"gmi/anthropic/claude-sonnet-4.5": {
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "gmi",
|
|
"max_input_tokens": 409600,
|
|
"max_output_tokens": 32000,
|
|
"max_tokens": 32000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_function_calling": true,
|
|
"supports_vision": true
|
|
},
|
|
"gmi/anthropic/claude-sonnet-4": {
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "gmi",
|
|
"max_input_tokens": 409600,
|
|
"max_output_tokens": 32000,
|
|
"max_tokens": 32000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_function_calling": true,
|
|
"supports_vision": true
|
|
},
|
|
"gmi/anthropic/claude-opus-4": {
|
|
"input_cost_per_token": 0.000015,
|
|
"litellm_provider": "gmi",
|
|
"max_input_tokens": 409600,
|
|
"max_output_tokens": 32000,
|
|
"max_tokens": 32000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000075,
|
|
"supports_function_calling": true,
|
|
"supports_vision": true
|
|
},
|
|
"global.anthropic.claude-sonnet-4-5-20250929-v1:0": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"input_cost_per_token_above_200k_tokens": 0.000006,
|
|
"output_cost_per_token_above_200k_tokens": 0.0000225,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.0000075,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6e-7,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346
|
|
},
|
|
"global.anthropic.claude-sonnet-4-20250514-v1:0": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"input_cost_per_token_above_200k_tokens": 0.000006,
|
|
"output_cost_per_token_above_200k_tokens": 0.0000225,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.0000075,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6e-7,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 1000000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"global.anthropic.claude-haiku-4-5-20251001-v1:0": {
|
|
"cache_creation_input_token_cost": 0.00000125,
|
|
"cache_read_input_token_cost": 1e-7,
|
|
"input_cost_per_token": 0.000001,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000005,
|
|
"source": "https://aws.amazon.com/about-aws/whats-new/2025/10/claude-4-5-haiku-anthropic-amazon-bedrock",
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346
|
|
},
|
|
"gradient_ai/anthropic-claude-3-opus": {
|
|
"input_cost_per_token": 0.000015,
|
|
"litellm_provider": "gradient_ai",
|
|
"max_tokens": 1024,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000075,
|
|
"supported_endpoints": [
|
|
"/v1/chat/completions"
|
|
],
|
|
"supported_modalities": [
|
|
"text"
|
|
],
|
|
"supports_tool_choice": false
|
|
},
|
|
"gradient_ai/anthropic-claude-3.5-haiku": {
|
|
"input_cost_per_token": 8e-7,
|
|
"litellm_provider": "gradient_ai",
|
|
"max_tokens": 1024,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000004,
|
|
"supported_endpoints": [
|
|
"/v1/chat/completions"
|
|
],
|
|
"supported_modalities": [
|
|
"text"
|
|
],
|
|
"supports_tool_choice": false
|
|
},
|
|
"gradient_ai/anthropic-claude-3.5-sonnet": {
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "gradient_ai",
|
|
"max_tokens": 1024,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supported_endpoints": [
|
|
"/v1/chat/completions"
|
|
],
|
|
"supported_modalities": [
|
|
"text"
|
|
],
|
|
"supports_tool_choice": false
|
|
},
|
|
"gradient_ai/anthropic-claude-3.7-sonnet": {
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "gradient_ai",
|
|
"max_tokens": 1024,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supported_endpoints": [
|
|
"/v1/chat/completions"
|
|
],
|
|
"supported_modalities": [
|
|
"text"
|
|
],
|
|
"supports_tool_choice": false
|
|
},
|
|
"jp.anthropic.claude-sonnet-4-5-20250929-v1:0": {
|
|
"cache_creation_input_token_cost": 0.000004125,
|
|
"cache_read_input_token_cost": 3.3e-7,
|
|
"input_cost_per_token": 0.0000033,
|
|
"input_cost_per_token_above_200k_tokens": 0.0000066,
|
|
"output_cost_per_token_above_200k_tokens": 0.00002475,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.00000825,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6.6e-7,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.0000165,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346
|
|
},
|
|
"jp.anthropic.claude-haiku-4-5-20251001-v1:0": {
|
|
"cache_creation_input_token_cost": 0.000001375,
|
|
"cache_read_input_token_cost": 1.1e-7,
|
|
"input_cost_per_token": 0.0000011,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.0000055,
|
|
"source": "https://aws.amazon.com/about-aws/whats-new/2025/10/claude-4-5-haiku-anthropic-amazon-bedrock",
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346
|
|
},
|
|
"openrouter/anthropic/claude-3-haiku": {
|
|
"input_cost_per_image": 0.0004,
|
|
"input_cost_per_token": 2.5e-7,
|
|
"litellm_provider": "openrouter",
|
|
"max_tokens": 200000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.00000125,
|
|
"supports_function_calling": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"openrouter/anthropic/claude-3.5-sonnet": {
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "openrouter",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"openrouter/anthropic/claude-3.7-sonnet": {
|
|
"input_cost_per_image": 0.0048,
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "openrouter",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 128000,
|
|
"max_tokens": 128000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_reasoning": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"openrouter/anthropic/claude-opus-4": {
|
|
"input_cost_per_image": 0.0048,
|
|
"cache_creation_input_token_cost": 0.00001875,
|
|
"cache_read_input_token_cost": 0.0000015,
|
|
"input_cost_per_token": 0.000015,
|
|
"litellm_provider": "openrouter",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 32000,
|
|
"max_tokens": 32000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000075,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"openrouter/anthropic/claude-opus-4.1": {
|
|
"input_cost_per_image": 0.0048,
|
|
"cache_creation_input_token_cost": 0.00001875,
|
|
"cache_creation_input_token_cost_above_1hr": 0.00003,
|
|
"cache_read_input_token_cost": 0.0000015,
|
|
"input_cost_per_token": 0.000015,
|
|
"litellm_provider": "openrouter",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 32000,
|
|
"max_tokens": 32000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000075,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"openrouter/anthropic/claude-sonnet-4": {
|
|
"input_cost_per_image": 0.0048,
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.0000075,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"input_cost_per_token_above_200k_tokens": 0.000006,
|
|
"output_cost_per_token_above_200k_tokens": 0.0000225,
|
|
"litellm_provider": "openrouter",
|
|
"max_input_tokens": 1000000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"openrouter/anthropic/claude-opus-4.5": {
|
|
"cache_creation_input_token_cost": 0.00000625,
|
|
"cache_read_input_token_cost": 5e-7,
|
|
"input_cost_per_token": 0.000005,
|
|
"litellm_provider": "openrouter",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 32000,
|
|
"max_tokens": 32000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000025,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"openrouter/anthropic/claude-opus-4.6": {
|
|
"cache_creation_input_token_cost": 0.00000625,
|
|
"cache_read_input_token_cost": 5e-7,
|
|
"input_cost_per_token": 0.000005,
|
|
"litellm_provider": "openrouter",
|
|
"max_input_tokens": 1000000,
|
|
"max_output_tokens": 128000,
|
|
"max_tokens": 128000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000025,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346
|
|
},
|
|
"openrouter/anthropic/claude-sonnet-4.5": {
|
|
"input_cost_per_image": 0.0048,
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"input_cost_per_token_above_200k_tokens": 0.000006,
|
|
"output_cost_per_token_above_200k_tokens": 0.0000225,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.0000075,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6e-7,
|
|
"litellm_provider": "openrouter",
|
|
"max_input_tokens": 1000000,
|
|
"max_output_tokens": 1000000,
|
|
"max_tokens": 1000000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"openrouter/anthropic/claude-haiku-4.5": {
|
|
"cache_creation_input_token_cost": 0.00000125,
|
|
"cache_read_input_token_cost": 1e-7,
|
|
"input_cost_per_token": 0.000001,
|
|
"litellm_provider": "openrouter",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 200000,
|
|
"max_tokens": 200000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000005,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346
|
|
},
|
|
"replicate/anthropic/claude-4.5-haiku": {
|
|
"input_cost_per_token": 0.000001,
|
|
"output_cost_per_token": 0.000005,
|
|
"litellm_provider": "replicate",
|
|
"mode": "chat",
|
|
"supports_function_calling": true,
|
|
"supports_parallel_function_calling": true,
|
|
"supports_vision": true,
|
|
"supports_system_messages": true,
|
|
"supports_tool_choice": true,
|
|
"supports_response_schema": true,
|
|
"supports_prompt_caching": true
|
|
},
|
|
"replicate/anthropic/claude-4-sonnet": {
|
|
"input_cost_per_token": 0.000003,
|
|
"output_cost_per_token": 0.000015,
|
|
"litellm_provider": "replicate",
|
|
"mode": "chat",
|
|
"supports_function_calling": true,
|
|
"supports_parallel_function_calling": true,
|
|
"supports_vision": true,
|
|
"supports_system_messages": true,
|
|
"supports_tool_choice": true,
|
|
"supports_response_schema": true,
|
|
"supports_prompt_caching": true
|
|
},
|
|
"replicate/anthropic/claude-3.7-sonnet": {
|
|
"input_cost_per_token": 0.000003,
|
|
"output_cost_per_token": 0.000015,
|
|
"litellm_provider": "replicate",
|
|
"mode": "chat",
|
|
"supports_function_calling": true,
|
|
"supports_parallel_function_calling": true,
|
|
"supports_vision": true,
|
|
"supports_system_messages": true,
|
|
"supports_tool_choice": true,
|
|
"supports_response_schema": true,
|
|
"supports_prompt_caching": true
|
|
},
|
|
"replicate/anthropic/claude-3.5-haiku": {
|
|
"input_cost_per_token": 0.000001,
|
|
"output_cost_per_token": 0.000005,
|
|
"litellm_provider": "replicate",
|
|
"mode": "chat",
|
|
"supports_function_calling": true,
|
|
"supports_parallel_function_calling": true,
|
|
"supports_vision": true,
|
|
"supports_system_messages": true,
|
|
"supports_tool_choice": true,
|
|
"supports_response_schema": true,
|
|
"supports_prompt_caching": true
|
|
},
|
|
"replicate/anthropic/claude-3.5-sonnet": {
|
|
"input_cost_per_token": 0.00000375,
|
|
"output_cost_per_token": 0.00001875,
|
|
"litellm_provider": "replicate",
|
|
"mode": "chat",
|
|
"supports_function_calling": true,
|
|
"supports_parallel_function_calling": true,
|
|
"supports_vision": true,
|
|
"supports_system_messages": true,
|
|
"supports_tool_choice": true,
|
|
"supports_response_schema": true,
|
|
"supports_prompt_caching": true
|
|
},
|
|
"replicate/anthropic/claude-4.5-sonnet": {
|
|
"input_cost_per_token": 0.000003,
|
|
"output_cost_per_token": 0.000015,
|
|
"litellm_provider": "replicate",
|
|
"mode": "chat",
|
|
"supports_function_calling": true,
|
|
"supports_parallel_function_calling": true,
|
|
"supports_vision": true,
|
|
"supports_system_messages": true,
|
|
"supports_tool_choice": true,
|
|
"supports_response_schema": true,
|
|
"supports_prompt_caching": true
|
|
},
|
|
"us.anthropic.claude-3-5-haiku-20241022-v1:0": {
|
|
"cache_creation_input_token_cost": 0.000001,
|
|
"cache_read_input_token_cost": 8e-8,
|
|
"input_cost_per_token": 8e-7,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000004,
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true
|
|
},
|
|
"us.anthropic.claude-haiku-4-5-20251001-v1:0": {
|
|
"cache_creation_input_token_cost": 0.000001375,
|
|
"cache_read_input_token_cost": 1.1e-7,
|
|
"input_cost_per_token": 0.0000011,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.0000055,
|
|
"source": "https://aws.amazon.com/about-aws/whats-new/2025/10/claude-4-5-haiku-anthropic-amazon-bedrock",
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346
|
|
},
|
|
"us.anthropic.claude-3-5-sonnet-20240620-v1:0": {
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 4096,
|
|
"max_tokens": 4096,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"us.anthropic.claude-3-5-sonnet-20241022-v2:0": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"us.anthropic.claude-3-7-sonnet-20250219-v1:0": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"us.anthropic.claude-3-haiku-20240307-v1:0": {
|
|
"input_cost_per_token": 2.5e-7,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 4096,
|
|
"max_tokens": 4096,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.00000125,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"us.anthropic.claude-3-opus-20240229-v1:0": {
|
|
"input_cost_per_token": 0.000015,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 4096,
|
|
"max_tokens": 4096,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000075,
|
|
"supports_function_calling": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"us.anthropic.claude-3-sonnet-20240229-v1:0": {
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "bedrock",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 4096,
|
|
"max_tokens": 4096,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"us.anthropic.claude-opus-4-1-20250805-v1:0": {
|
|
"cache_creation_input_token_cost": 0.00001875,
|
|
"cache_read_input_token_cost": 0.0000015,
|
|
"input_cost_per_token": 0.000015,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 32000,
|
|
"max_tokens": 32000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000075,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"us.anthropic.claude-sonnet-4-5-20250929-v1:0": {
|
|
"cache_creation_input_token_cost": 0.000004125,
|
|
"cache_read_input_token_cost": 3.3e-7,
|
|
"input_cost_per_token": 0.0000033,
|
|
"input_cost_per_token_above_200k_tokens": 0.0000066,
|
|
"output_cost_per_token_above_200k_tokens": 0.00002475,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.00000825,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6.6e-7,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.0000165,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346
|
|
},
|
|
"au.anthropic.claude-haiku-4-5-20251001-v1:0": {
|
|
"cache_creation_input_token_cost": 0.000001375,
|
|
"cache_read_input_token_cost": 1.1e-7,
|
|
"input_cost_per_token": 0.0000011,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.0000055,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346
|
|
},
|
|
"us.anthropic.claude-opus-4-20250514-v1:0": {
|
|
"cache_creation_input_token_cost": 0.00001875,
|
|
"cache_read_input_token_cost": 0.0000015,
|
|
"input_cost_per_token": 0.000015,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 32000,
|
|
"max_tokens": 32000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000075,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"us.anthropic.claude-opus-4-5-20251101-v1:0": {
|
|
"cache_creation_input_token_cost": 0.000006875,
|
|
"cache_read_input_token_cost": 5.5e-7,
|
|
"input_cost_per_token": 0.0000055,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.0000275,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"global.anthropic.claude-opus-4-5-20251101-v1:0": {
|
|
"cache_creation_input_token_cost": 0.00000625,
|
|
"cache_read_input_token_cost": 5e-7,
|
|
"input_cost_per_token": 0.000005,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000025,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"eu.anthropic.claude-opus-4-5-20251101-v1:0": {
|
|
"cache_creation_input_token_cost": 0.00000625,
|
|
"cache_read_input_token_cost": 5e-7,
|
|
"input_cost_per_token": 0.000005,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000025,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"us.anthropic.claude-sonnet-4-20250514-v1:0": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"input_cost_per_token_above_200k_tokens": 0.000006,
|
|
"output_cost_per_token_above_200k_tokens": 0.0000225,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.0000075,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6e-7,
|
|
"litellm_provider": "bedrock_converse",
|
|
"max_input_tokens": 1000000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"vercel_ai_gateway/anthropic/claude-3-haiku": {
|
|
"cache_creation_input_token_cost": 3e-7,
|
|
"cache_read_input_token_cost": 3e-8,
|
|
"input_cost_per_token": 2.5e-7,
|
|
"litellm_provider": "vercel_ai_gateway",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 4096,
|
|
"max_tokens": 4096,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.00000125,
|
|
"supports_vision": true,
|
|
"supports_function_calling": true,
|
|
"supports_tool_choice": true,
|
|
"supports_response_schema": true
|
|
},
|
|
"vercel_ai_gateway/anthropic/claude-3-opus": {
|
|
"cache_creation_input_token_cost": 0.00001875,
|
|
"cache_read_input_token_cost": 0.0000015,
|
|
"input_cost_per_token": 0.000015,
|
|
"litellm_provider": "vercel_ai_gateway",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 4096,
|
|
"max_tokens": 4096,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000075,
|
|
"supports_vision": true,
|
|
"supports_function_calling": true,
|
|
"supports_tool_choice": true,
|
|
"supports_response_schema": true
|
|
},
|
|
"vercel_ai_gateway/anthropic/claude-3.5-haiku": {
|
|
"cache_creation_input_token_cost": 0.000001,
|
|
"cache_read_input_token_cost": 8e-8,
|
|
"input_cost_per_token": 8e-7,
|
|
"litellm_provider": "vercel_ai_gateway",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000004,
|
|
"supports_vision": true,
|
|
"supports_function_calling": true,
|
|
"supports_tool_choice": true,
|
|
"supports_response_schema": true
|
|
},
|
|
"vercel_ai_gateway/anthropic/claude-3.5-sonnet": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "vercel_ai_gateway",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_vision": true,
|
|
"supports_function_calling": true,
|
|
"supports_tool_choice": true,
|
|
"supports_response_schema": true
|
|
},
|
|
"vercel_ai_gateway/anthropic/claude-3.7-sonnet": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "vercel_ai_gateway",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_vision": true,
|
|
"supports_function_calling": true,
|
|
"supports_tool_choice": true,
|
|
"supports_response_schema": true
|
|
},
|
|
"vercel_ai_gateway/anthropic/claude-4-opus": {
|
|
"cache_creation_input_token_cost": 0.00001875,
|
|
"cache_read_input_token_cost": 0.0000015,
|
|
"input_cost_per_token": 0.000015,
|
|
"litellm_provider": "vercel_ai_gateway",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 32000,
|
|
"max_tokens": 32000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000075,
|
|
"supports_vision": true,
|
|
"supports_function_calling": true,
|
|
"supports_tool_choice": true,
|
|
"supports_response_schema": true
|
|
},
|
|
"vercel_ai_gateway/anthropic/claude-4-sonnet": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "vercel_ai_gateway",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_function_calling": true,
|
|
"supports_tool_choice": true
|
|
},
|
|
"vercel_ai_gateway/anthropic/claude-3-5-sonnet": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "vercel_ai_gateway",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"vercel_ai_gateway/anthropic/claude-3-5-sonnet-20241022": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "vercel_ai_gateway",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"vercel_ai_gateway/anthropic/claude-3-7-sonnet": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "vercel_ai_gateway",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"vercel_ai_gateway/anthropic/claude-haiku-4.5": {
|
|
"cache_creation_input_token_cost": 0.00000125,
|
|
"cache_read_input_token_cost": 1e-7,
|
|
"input_cost_per_token": 0.000001,
|
|
"litellm_provider": "vercel_ai_gateway",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000005,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"vercel_ai_gateway/anthropic/claude-opus-4": {
|
|
"cache_creation_input_token_cost": 0.00001875,
|
|
"cache_read_input_token_cost": 0.0000015,
|
|
"input_cost_per_token": 0.000015,
|
|
"litellm_provider": "vercel_ai_gateway",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 32000,
|
|
"max_tokens": 32000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000075,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"vercel_ai_gateway/anthropic/claude-opus-4.1": {
|
|
"cache_creation_input_token_cost": 0.00001875,
|
|
"cache_read_input_token_cost": 0.0000015,
|
|
"input_cost_per_token": 0.000015,
|
|
"litellm_provider": "vercel_ai_gateway",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 32000,
|
|
"max_tokens": 32000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000075,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"vercel_ai_gateway/anthropic/claude-opus-4.5": {
|
|
"cache_creation_input_token_cost": 0.00000625,
|
|
"cache_read_input_token_cost": 5e-7,
|
|
"input_cost_per_token": 0.000005,
|
|
"litellm_provider": "vercel_ai_gateway",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000025,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"vercel_ai_gateway/anthropic/claude-opus-4.6": {
|
|
"cache_creation_input_token_cost": 0.00000625,
|
|
"cache_read_input_token_cost": 5e-7,
|
|
"input_cost_per_token": 0.000005,
|
|
"litellm_provider": "vercel_ai_gateway",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000025,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"vercel_ai_gateway/anthropic/claude-sonnet-4": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "vercel_ai_gateway",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"vercel_ai_gateway/anthropic/claude-sonnet-4.5": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "vercel_ai_gateway",
|
|
"max_input_tokens": 1000000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"vertex_ai/claude-3-5-haiku": {
|
|
"input_cost_per_token": 0.000001,
|
|
"litellm_provider": "vertex_ai-anthropic_models",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000005,
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_tool_choice": true
|
|
},
|
|
"vertex_ai/claude-3-5-haiku@20241022": {
|
|
"input_cost_per_token": 0.000001,
|
|
"litellm_provider": "vertex_ai-anthropic_models",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000005,
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_tool_choice": true
|
|
},
|
|
"vertex_ai/claude-haiku-4-5@20251001": {
|
|
"cache_creation_input_token_cost": 0.00000125,
|
|
"cache_read_input_token_cost": 1e-7,
|
|
"input_cost_per_token": 0.000001,
|
|
"litellm_provider": "vertex_ai-anthropic_models",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000005,
|
|
"source": "https://cloud.google.com/vertex-ai/generative-ai/docs/partner-models/claude/haiku-4-5",
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_native_streaming": true,
|
|
"supports_vision": true
|
|
},
|
|
"vertex_ai/claude-3-5-sonnet": {
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "vertex_ai-anthropic_models",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"vertex_ai/claude-3-5-sonnet-v2": {
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "vertex_ai-anthropic_models",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"vertex_ai/claude-3-5-sonnet-v2@20241022": {
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "vertex_ai-anthropic_models",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"vertex_ai/claude-3-5-sonnet@20240620": {
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "vertex_ai-anthropic_models",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"vertex_ai/claude-3-7-sonnet@20250219": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"deprecation_date": "2025-06-01",
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "vertex_ai-anthropic_models",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 8192,
|
|
"max_tokens": 8192,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"vertex_ai/claude-3-haiku": {
|
|
"input_cost_per_token": 2.5e-7,
|
|
"litellm_provider": "vertex_ai-anthropic_models",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 4096,
|
|
"max_tokens": 4096,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.00000125,
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"vertex_ai/claude-3-haiku@20240307": {
|
|
"input_cost_per_token": 2.5e-7,
|
|
"litellm_provider": "vertex_ai-anthropic_models",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 4096,
|
|
"max_tokens": 4096,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.00000125,
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"vertex_ai/claude-3-opus": {
|
|
"input_cost_per_token": 0.000015,
|
|
"litellm_provider": "vertex_ai-anthropic_models",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 4096,
|
|
"max_tokens": 4096,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000075,
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"vertex_ai/claude-3-opus@20240229": {
|
|
"input_cost_per_token": 0.000015,
|
|
"litellm_provider": "vertex_ai-anthropic_models",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 4096,
|
|
"max_tokens": 4096,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000075,
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"vertex_ai/claude-3-sonnet": {
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "vertex_ai-anthropic_models",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 4096,
|
|
"max_tokens": 4096,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"vertex_ai/claude-3-sonnet@20240229": {
|
|
"input_cost_per_token": 0.000003,
|
|
"litellm_provider": "vertex_ai-anthropic_models",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 4096,
|
|
"max_tokens": 4096,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"vertex_ai/claude-opus-4": {
|
|
"cache_creation_input_token_cost": 0.00001875,
|
|
"cache_read_input_token_cost": 0.0000015,
|
|
"input_cost_per_token": 0.000015,
|
|
"litellm_provider": "vertex_ai-anthropic_models",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 32000,
|
|
"max_tokens": 32000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000075,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"vertex_ai/claude-opus-4-1": {
|
|
"cache_creation_input_token_cost": 0.00001875,
|
|
"cache_read_input_token_cost": 0.0000015,
|
|
"input_cost_per_token": 0.000015,
|
|
"input_cost_per_token_batches": 0.0000075,
|
|
"litellm_provider": "vertex_ai-anthropic_models",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 32000,
|
|
"max_tokens": 32000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000075,
|
|
"output_cost_per_token_batches": 0.0000375,
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"vertex_ai/claude-opus-4-1@20250805": {
|
|
"cache_creation_input_token_cost": 0.00001875,
|
|
"cache_read_input_token_cost": 0.0000015,
|
|
"input_cost_per_token": 0.000015,
|
|
"input_cost_per_token_batches": 0.0000075,
|
|
"litellm_provider": "vertex_ai-anthropic_models",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 32000,
|
|
"max_tokens": 32000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000075,
|
|
"output_cost_per_token_batches": 0.0000375,
|
|
"supports_assistant_prefill": true,
|
|
"supports_function_calling": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"vertex_ai/claude-opus-4-5": {
|
|
"cache_creation_input_token_cost": 0.00000625,
|
|
"cache_read_input_token_cost": 5e-7,
|
|
"input_cost_per_token": 0.000005,
|
|
"litellm_provider": "vertex_ai-anthropic_models",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000025,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"vertex_ai/claude-opus-4-5@20251101": {
|
|
"cache_creation_input_token_cost": 0.00000625,
|
|
"cache_read_input_token_cost": 5e-7,
|
|
"input_cost_per_token": 0.000005,
|
|
"litellm_provider": "vertex_ai-anthropic_models",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000025,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159,
|
|
"supports_native_streaming": true
|
|
},
|
|
"vertex_ai/claude-opus-4-6": {
|
|
"cache_creation_input_token_cost": 0.00000625,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.0000125,
|
|
"cache_read_input_token_cost": 5e-7,
|
|
"cache_read_input_token_cost_above_200k_tokens": 0.000001,
|
|
"input_cost_per_token": 0.000005,
|
|
"input_cost_per_token_above_200k_tokens": 0.00001,
|
|
"litellm_provider": "vertex_ai-anthropic_models",
|
|
"max_input_tokens": 1000000,
|
|
"max_output_tokens": 128000,
|
|
"max_tokens": 128000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000025,
|
|
"output_cost_per_token_above_200k_tokens": 0.0000375,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": false,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346
|
|
},
|
|
"vertex_ai/claude-opus-4-6@default": {
|
|
"cache_creation_input_token_cost": 0.00000625,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.0000125,
|
|
"cache_read_input_token_cost": 5e-7,
|
|
"cache_read_input_token_cost_above_200k_tokens": 0.000001,
|
|
"input_cost_per_token": 0.000005,
|
|
"input_cost_per_token_above_200k_tokens": 0.00001,
|
|
"litellm_provider": "vertex_ai-anthropic_models",
|
|
"max_input_tokens": 1000000,
|
|
"max_output_tokens": 128000,
|
|
"max_tokens": 128000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000025,
|
|
"output_cost_per_token_above_200k_tokens": 0.0000375,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": false,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346
|
|
},
|
|
"vertex_ai/claude-sonnet-4-5": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"input_cost_per_token_above_200k_tokens": 0.000006,
|
|
"output_cost_per_token_above_200k_tokens": 0.0000225,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.0000075,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6e-7,
|
|
"input_cost_per_token_batches": 0.0000015,
|
|
"litellm_provider": "vertex_ai-anthropic_models",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"output_cost_per_token_batches": 0.0000075,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true
|
|
},
|
|
"vertex_ai/claude-sonnet-4-6": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.0000075,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"input_cost_per_token_above_200k_tokens": 0.000006,
|
|
"litellm_provider": "vertex_ai-anthropic_models",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"output_cost_per_token_above_200k_tokens": 0.0000225,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
}
|
|
},
|
|
"vertex_ai/claude-sonnet-4-5@20250929": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"input_cost_per_token_above_200k_tokens": 0.000006,
|
|
"output_cost_per_token_above_200k_tokens": 0.0000225,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.0000075,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6e-7,
|
|
"input_cost_per_token_batches": 0.0000015,
|
|
"litellm_provider": "vertex_ai-anthropic_models",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"output_cost_per_token_batches": 0.0000075,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"supports_native_streaming": true
|
|
},
|
|
"vertex_ai/claude-opus-4@20250514": {
|
|
"cache_creation_input_token_cost": 0.00001875,
|
|
"cache_read_input_token_cost": 0.0000015,
|
|
"input_cost_per_token": 0.000015,
|
|
"litellm_provider": "vertex_ai-anthropic_models",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 32000,
|
|
"max_tokens": 32000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000075,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"vertex_ai/claude-sonnet-4": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"input_cost_per_token_above_200k_tokens": 0.000006,
|
|
"output_cost_per_token_above_200k_tokens": 0.0000225,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.0000075,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6e-7,
|
|
"litellm_provider": "vertex_ai-anthropic_models",
|
|
"max_input_tokens": 1000000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"vertex_ai/claude-sonnet-4@20250514": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"input_cost_per_token_above_200k_tokens": 0.000006,
|
|
"output_cost_per_token_above_200k_tokens": 0.0000225,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.0000075,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6e-7,
|
|
"litellm_provider": "vertex_ai-anthropic_models",
|
|
"max_input_tokens": 1000000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
},
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 159
|
|
},
|
|
"vertex_ai/claude-sonnet-4-6@default": {
|
|
"cache_creation_input_token_cost": 0.00000375,
|
|
"cache_creation_input_token_cost_above_200k_tokens": 0.0000075,
|
|
"cache_read_input_token_cost": 3e-7,
|
|
"cache_read_input_token_cost_above_200k_tokens": 6e-7,
|
|
"input_cost_per_token": 0.000003,
|
|
"input_cost_per_token_above_200k_tokens": 0.000006,
|
|
"litellm_provider": "vertex_ai-anthropic_models",
|
|
"max_input_tokens": 200000,
|
|
"max_output_tokens": 64000,
|
|
"max_tokens": 64000,
|
|
"mode": "chat",
|
|
"output_cost_per_token": 0.000015,
|
|
"output_cost_per_token_above_200k_tokens": 0.0000225,
|
|
"supports_assistant_prefill": true,
|
|
"supports_computer_use": true,
|
|
"supports_function_calling": true,
|
|
"supports_pdf_input": true,
|
|
"supports_prompt_caching": true,
|
|
"supports_reasoning": true,
|
|
"supports_response_schema": true,
|
|
"supports_tool_choice": true,
|
|
"supports_vision": true,
|
|
"tool_use_system_prompt_tokens": 346,
|
|
"search_context_cost_per_query": {
|
|
"search_context_size_high": 0.01,
|
|
"search_context_size_low": 0.01,
|
|
"search_context_size_medium": 0.01
|
|
}
|
|
}
|
|
} |