Instructions to use kyLELEng/market-gpt-return-token with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use kyLELEng/market-gpt-return-token with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="kyLELEng/market-gpt-return-token")

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("kyLELEng/market-gpt-return-token")
model = AutoModelForCausalLM.from_pretrained("kyLELEng/market-gpt-return-token")

Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use kyLELEng/market-gpt-return-token with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "kyLELEng/market-gpt-return-token"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "kyLELEng/market-gpt-return-token",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/kyLELEng/market-gpt-return-token

SGLang

How to use kyLELEng/market-gpt-return-token with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "kyLELEng/market-gpt-return-token" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "kyLELEng/market-gpt-return-token",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "kyLELEng/market-gpt-return-token" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "kyLELEng/market-gpt-return-token",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use kyLELEng/market-gpt-return-token with Docker Model Runner:
```
docker model run hf.co/kyLELEng/market-gpt-return-token
```

market-gpt-return-token / bucket_edges.json

kyLELEng

Train MarketGPT return-token model

c011bf2 verified 17 days ago

raw

history blame contribute delete

2.27 kB

	[
	-5.0,
	-2.5640621185302734,
	-2.0861096382141113,
	-1.8310669660568237,
	-1.6588560342788696,
	-1.5273399353027344,
	-1.412660837173462,
	-1.3142497539520264,
	-1.2324836254119873,
	-1.1628164052963257,
	-1.0965759754180908,
	-1.0370841026306152,
	-0.9799642562866211,
	-0.9281984567642212,
	-0.8819820284843445,
	-0.8356001377105713,
	-0.7926501631736755,
	-0.755145788192749,
	-0.7170299887657166,
	-0.678482711315155,
	-0.6437629461288452,
	-0.6132894158363342,
	-0.5807541012763977,
	-0.5498068332672119,
	-0.520163893699646,
	-0.48915788531303406,
	-0.46171873807907104,
	-0.4333514869213104,
	-0.4081476032733917,
	-0.38186678290367126,
	-0.3573564887046814,
	-0.3329995274543762,
	-0.3090900182723999,
	-0.2860213816165924,
	-0.2642545998096466,
	-0.24296307563781738,
	-0.22225084900856018,
	-0.20184440910816193,
	-0.18016014993190765,
	-0.16107362508773804,
	-0.14016427099704742,
	-0.12129930406808853,
	-0.10306043177843094,
	-0.0838770791888237,
	-0.0651112049818039,
	-0.048510488122701645,
	-0.03162214905023575,
	-0.012857679277658463,
	0.0,
	0.003500344231724739,
	0.024453746154904366,
	0.042099423706531525,
	0.05944214388728142,
	0.07699255645275116,
	0.09591319411993027,
	0.11562864482402802,
	0.134685680270195,
	0.15423625707626343,
	0.175302654504776,
	0.1944105327129364,
	0.21569515764713287,
	0.23659121990203857,
	0.25711652636528015,
	0.27793654799461365,
	0.29974064230918884,
	0.32058408856391907,
	0.3441528081893921,
	0.3674743175506592,
	0.3901389539241791,
	0.41622453927993774,
	0.439811646938324,
	0.46468427777290344,
	0.48801037669181824,
	0.5133446455001831,
	0.5387183427810669,
	0.5662073493003845,
	0.5953604578971863,
	0.6257803440093994,
	0.6574458479881287,
	0.6881090998649597,
	0.7192966938018799,
	0.7515752911567688,
	0.7850026488304138,
	0.8196272850036621,
	0.856989324092865,
	0.8949403762817383,
	0.9338142275810242,
	0.9723265767097473,
	1.016391396522522,
	1.0668745040893555,
	1.1130402088165283,
	1.169913411140442,
	1.2257028818130493,
	1.2931857109069824,
	1.3646200895309448,
	1.4440101385116577,
	1.539734125137329,
	1.6749216318130493,
	1.8327667713165283,
	2.051732301712036,
	2.4239859580993652,
	5.0
	]