ai models

Warning

I’m experimenting models. It’s only my personal view.

ModelGoodBad
gpt-4o- Fast
- General purpose
- Respect system prompts
- Sometimes does not provide good suggestion
claude-3.7-sonnet- Good code suggestion- A bit slow
- Often timeout / rate limited
claude-sonnet-4- Fast
- Really good code suggestion
- Works best with claude code
gemini-2.5-pro- “Free”
- Fast
- A bit slow
- Often timeout / rate limited

Difference Between Using claude-sonnet-4 with GitHub Copilot License vs. Anthropic License

1. Provider and Integration

  • GitHub Copilot License:

    • The model is accessed via GitHub Copilot, which is integrated into editors like VS Code, Neovim, and JetBrains IDEs.
    • The experience is tailored for code completion, code suggestions, and developer productivity.
    • The model may be fine-tuned or prompt-engineered specifically for Copilot workflows.
    • Usage is governed by GitHub’s terms of service and privacy policy.
  • Anthropic License:

    • The model is accessed directly via Anthropic’s API or platform (e.g., Claude web interface, API endpoints).
    • You have more flexibility in how you use the model (e.g., chatbots, custom apps, research).
    • Usage is governed by Anthropic’s terms of service and privacy policy.

2. Features and Capabilities

  • GitHub Copilot:

    • Focused on code generation, completion, and in-editor assistance.
    • May have guardrails or limitations specific to code safety and compliance.
    • May not expose the full range of model capabilities (e.g., general conversation, document analysis).
  • Anthropic Direct:

    • Full access to the model’s capabilities, including general conversation, reasoning, summarization, and more.
    • Can be used for a wider range of tasks beyond code (e.g., writing, analysis, Q&A).

3. Pricing and Quotas

  • GitHub Copilot:

    • Pricing is per user/month, bundled with Copilot features.
    • Usage is typically unlimited within reasonable bounds for code completion.
  • Anthropic:

    • Pricing is based on API usage (tokens in/out).
    • You pay for what you use, which can be more cost-effective or more expensive depending on your usage pattern.

4. Data Privacy and Security

  • GitHub Copilot:

    • Your code and prompts may be sent to GitHub/Microsoft servers.
    • Subject to GitHub’s data handling and retention policies.
  • Anthropic:

    • Your data is sent directly to Anthropic.
    • Subject to Anthropic’s data handling and retention policies.

5. Customization and Control

  • GitHub Copilot:

    • Limited customization; you use the model as provided by GitHub.
    • No direct access to model parameters or API.
  • Anthropic:

    • More control over prompts, system instructions, and API usage.
    • Can integrate into custom workflows and applications.

Summary Table:

AspectGitHub Copilot LicenseAnthropic License
AccessIn-editor (Copilot)API, web, custom apps
FocusCode completionGeneral-purpose AI
CustomizationLowHigh
PricingSubscriptionPay-per-use (tokens)
Data PolicyGitHub/MicrosoftAnthropic

References:

References