How to deploy Databricks Dolly v2 12b, instruction tuned casual language model.
Blog post from Deepinfra
Databricks Dolly v2 12b is a 12 billion parameter instruction-tuned casual language model derived from EleutherAI's pythia-12b and pretrained on The Pile and GPT-J's pretraining corpus. This model is optimized using the open-source databricks-dolly-15k instruction-following dataset and can be deployed through the DeepInfra web dashboard or API, with the deployment triggered upon the first inference request. Inference requests can be made via a REST API, and usage is priced at $0.0005 per second, running on Nvidia A100 cards. DeepInfra provides a fully managed GPU infrastructure for scalable model hosting, and users can access further documentation and support through their website and Discord server.
| Trend | Post Mentions | Total Month Mentions | Posts | Companies | MoM |
|---|---|---|---|---|---|
| LLM | 3 | 805 | 142 | 68 | -5% |
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.