A Python library for parallel LLM inference across providers, built on Polars DataFrames.
Polar Llama is a Python library that enables parallel inference calls to multiple Large Language Model providers through Polars dataframes. It streamlines batch processing of AI queries without serial request delays, making it ideal for data-intensive AI applications.
Send multiple inference requests in parallel without waiting for individual completions
Leverages efficient Polars dataframe operations for request management
Supports context-preserving conversations across multiple message exchanges
Connects with OpenAI, Anthropic, Gemini, Groq, and AWS Bedrock models
Get started with a simple example
Maintain context across multiple messages for more natural interactions
Process customer feedback at scale
Generate multiple content variations in parallel
Automated code review suggestions
Polar Llama supports multiple LLM providers
Set up your API keys in a .env file:
Run tests with configured providers:
Process large datasets with AI insights — sentiment analysis, classification, entity extraction
Generate product descriptions, marketing copy, or documentation at scale
Summarize documents, extract key points, or answer questions about large text corpora
Automate repetitive AI tasks like code review, email categorization, or data enrichment
Licensed under MIT.
Questions or issues? Open one on GitHub.