Skip to content

Commit 434e8cc

Browse files
committed
Refactor: Remove tools module and related functionality
- Deleted the tools module which included ModelDiscovery, HealthMonitor, CostCalculator, and ProviderRateLimiter. - Updated lib.rs to remove references to the deleted tools module and restructured the module exports. - Removed the sdk.rs file, consolidating SDK-related functionality into core and other relevant modules. - Adjusted documentation to reflect the changes in features and structure of the SDK.
1 parent 905fdf2 commit 434e8cc

File tree

21 files changed

+164
-4852
lines changed

21 files changed

+164
-4852
lines changed

.github/workflows/ci.yml

Lines changed: 0 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -42,12 +42,6 @@ jobs:
4242
- name: Check documentation
4343
run: cargo doc --no-deps --all-features
4444

45-
- name: Test SDK examples
46-
run: |
47-
cargo check --example basic_usage
48-
cargo check --example streaming
49-
cargo check --example multiple_providers
50-
5145
# Security audit
5246
audit:
5347
name: Security Audit
@@ -119,13 +113,6 @@ jobs:
119113
env:
120114
DATABASE_URL: postgresql://postgres:postgres@localhost:5432/gateway_test
121115
REDIS_URL: redis://localhost:6379
122-
123-
- name: Test SDK features
124-
run: |
125-
cargo test --no-default-features --features "sdk,openai"
126-
cargo test --no-default-features --features "sdk,anthropic"
127-
cargo test --no-default-features --features "sdk,tools"
128-
cargo test --no-default-features --features "sdk,config-management"
129116
JWT_SECRET: test-secret-key-for-ci
130117
RUST_LOG: debug
131118

.github/workflows/release.yml

Lines changed: 2 additions & 26 deletions
Original file line numberDiff line numberDiff line change
@@ -206,25 +206,8 @@ jobs:
206206
sudo apt-get update
207207
sudo apt-get install -y libpq-dev pkg-config libssl-dev
208208
209-
- name: Verify version matches tag
210-
run: |
211-
CARGO_VERSION=$(cargo metadata --no-deps --format-version 1 | jq -r '.packages[0].version')
212-
TAG_VERSION=${GITHUB_REF#refs/tags/v}
213-
if [ "$CARGO_VERSION" != "$TAG_VERSION" ]; then
214-
echo "Version mismatch: Cargo.toml has $CARGO_VERSION, tag is $TAG_VERSION"
215-
exit 1
216-
fi
217-
218-
- name: Run tests before publishing
219-
run: cargo test --all-features
220-
221209
- name: Publish to crates.io
222-
run: cargo publish --all-features --token ${{ secrets.CRATES_IO_TOKEN }}
223-
224-
- name: Notify publication success
225-
run: |
226-
echo "🎉 LiteLLM-RS ${GITHUB_REF#refs/tags/v} published to crates.io!"
227-
echo "📦 Install with: cargo add litellm-rs"
210+
run: cargo publish --token ${{ secrets.CRATES_IO_TOKEN }}
228211

229212
# Update Homebrew formula (for macOS users)
230213
homebrew-release:
@@ -256,21 +239,14 @@ jobs:
256239
# Add your staging deployment commands here
257240
# For example, update Kubernetes deployment, trigger ArgoCD sync, etc.
258241
259-
260-
261242
# Deploy to production (manual approval required)
262243
deploy-production:
263244
name: Deploy to Production
264-
needs: [create-release, docker-release, deploy-staging, publish-crate]
245+
needs: [create-release, docker-release, deploy-staging]
265246
runs-on: ubuntu-latest
266247
environment: production
267248
steps:
268249
- name: Deploy to production
269250
run: |
270251
echo "Deploying version ${{ needs.create-release.outputs.version }} to production"
271252
# Add your production deployment commands here
272-
273-
- name: Notify crate publication
274-
run: |
275-
echo "🎉 LiteLLM-RS ${{ needs.create-release.outputs.version }} published to crates.io!"
276-
echo "📦 Install with: cargo add litellm-rs"

CHANGELOG.md

Lines changed: 0 additions & 28 deletions
Original file line numberDiff line numberDiff line change
@@ -7,34 +7,6 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
77

88
## [Unreleased]
99

10-
### Added
11-
- **Unified LLM Provider SDK**: New SDK mode for using LiteLLM as a Rust library
12-
- **Dual-mode operation**: Use as SDK library or deploy as gateway server
13-
- **Enhanced provider support**: 20+ LLM providers with unified interface
14-
- **Intelligent load balancing**: Multiple strategies (round-robin, weighted, health-based)
15-
- **Cost optimization tools**: Compare and optimize costs across providers
16-
- **Health monitoring**: Continuous provider health checking and failover
17-
- **Request standardization**: Convert requests/responses between provider formats
18-
- **Configuration management**: Support for file, environment, and remote configs
19-
- **Comprehensive examples**: SDK usage examples for common scenarios
20-
- **Feature flags**: Modular builds with provider-specific features
21-
22-
### Changed
23-
- **Project structure**: Reorganized for dual SDK/Gateway mode
24-
- **API design**: Added fluent builder patterns for SDK usage
25-
- **Documentation**: Enhanced with SDK usage examples and best practices
26-
- **Feature system**: Granular feature flags for optimal builds
27-
28-
### SDK Components
29-
- `LiteLLM`: Main SDK client with provider management
30-
- `ChatCompletionBuilder`: Fluent API for chat completions
31-
- `ProviderRegistry`: Centralized provider management
32-
- `ProviderManager`: Load balancing and failover logic
33-
- `ModelDiscovery`: Discover available models across providers
34-
- `HealthMonitor`: Monitor provider health and performance
35-
- `CostCalculator`: Calculate and compare costs
36-
- `UniversalConverter`: Standardize requests/responses
37-
3810
## [0.1.0] - 2024-12-15
3911

4012
### Added

CONTRIBUTING.md

Lines changed: 0 additions & 283 deletions
This file was deleted.

0 commit comments

Comments
 (0)