Text Generation
Transformers
Safetensors
gpt2
causal-lm
time-series
finance
return-tokenization
probabilistic-generation
text-generation-inference
Instructions to use kyLELEng/market-gpt-return-token with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use kyLELEng/market-gpt-return-token with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="kyLELEng/market-gpt-return-token")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("kyLELEng/market-gpt-return-token") model = AutoModelForCausalLM.from_pretrained("kyLELEng/market-gpt-return-token") - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use kyLELEng/market-gpt-return-token with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "kyLELEng/market-gpt-return-token" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "kyLELEng/market-gpt-return-token", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/kyLELEng/market-gpt-return-token
- SGLang
How to use kyLELEng/market-gpt-return-token with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "kyLELEng/market-gpt-return-token" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "kyLELEng/market-gpt-return-token", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "kyLELEng/market-gpt-return-token" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "kyLELEng/market-gpt-return-token", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use kyLELEng/market-gpt-return-token with Docker Model Runner:
docker model run hf.co/kyLELEng/market-gpt-return-token
File size: 2,273 Bytes
c011bf2 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 | [
-5.0,
-2.5640621185302734,
-2.0861096382141113,
-1.8310669660568237,
-1.6588560342788696,
-1.5273399353027344,
-1.412660837173462,
-1.3142497539520264,
-1.2324836254119873,
-1.1628164052963257,
-1.0965759754180908,
-1.0370841026306152,
-0.9799642562866211,
-0.9281984567642212,
-0.8819820284843445,
-0.8356001377105713,
-0.7926501631736755,
-0.755145788192749,
-0.7170299887657166,
-0.678482711315155,
-0.6437629461288452,
-0.6132894158363342,
-0.5807541012763977,
-0.5498068332672119,
-0.520163893699646,
-0.48915788531303406,
-0.46171873807907104,
-0.4333514869213104,
-0.4081476032733917,
-0.38186678290367126,
-0.3573564887046814,
-0.3329995274543762,
-0.3090900182723999,
-0.2860213816165924,
-0.2642545998096466,
-0.24296307563781738,
-0.22225084900856018,
-0.20184440910816193,
-0.18016014993190765,
-0.16107362508773804,
-0.14016427099704742,
-0.12129930406808853,
-0.10306043177843094,
-0.0838770791888237,
-0.0651112049818039,
-0.048510488122701645,
-0.03162214905023575,
-0.012857679277658463,
0.0,
0.003500344231724739,
0.024453746154904366,
0.042099423706531525,
0.05944214388728142,
0.07699255645275116,
0.09591319411993027,
0.11562864482402802,
0.134685680270195,
0.15423625707626343,
0.175302654504776,
0.1944105327129364,
0.21569515764713287,
0.23659121990203857,
0.25711652636528015,
0.27793654799461365,
0.29974064230918884,
0.32058408856391907,
0.3441528081893921,
0.3674743175506592,
0.3901389539241791,
0.41622453927993774,
0.439811646938324,
0.46468427777290344,
0.48801037669181824,
0.5133446455001831,
0.5387183427810669,
0.5662073493003845,
0.5953604578971863,
0.6257803440093994,
0.6574458479881287,
0.6881090998649597,
0.7192966938018799,
0.7515752911567688,
0.7850026488304138,
0.8196272850036621,
0.856989324092865,
0.8949403762817383,
0.9338142275810242,
0.9723265767097473,
1.016391396522522,
1.0668745040893555,
1.1130402088165283,
1.169913411140442,
1.2257028818130493,
1.2931857109069824,
1.3646200895309448,
1.4440101385116577,
1.539734125137329,
1.6749216318130493,
1.8327667713165283,
2.051732301712036,
2.4239859580993652,
5.0
] |