A Jev-powered bot for Bluesky and Slack.
talky-jev docs request-focus.md
9.1 kB · 168 lines
Markdown
at main

Request focus without response categories #

24 local Jev drafts: three literal user requests, seeds 1 and 7, four variants. Six preliminary Choice calls selected an exact contiguous 1–5-word span of each request. These are dynamically enumerated input spans, not a hand-authored menu of bot capabilities. No answer text, topic list, response type, persona, profile, history or images were supplied. Production is unchanged.

All arms use the same structured request/current-answer state, 5,000-word vocabulary, original natural-completion judgments, 35% stopping coin, finalist scoring and 300-character ceiling. The full-request arm repeats the whole request in a request_focus field; span-state uses the selected span instead; span-instruction also repeats it in the next-word instruction. The baseline has neither extra field nor instruction. Jobs were shuffled with seed 20261020 and run with two workers. Different trajectories are not guaranteed to consume identical calls despite identical sampling seeds.

Script: request_focus.py. Call counts, end checks and generated prefixes are in ignored scratch/request-focus. All 24 expected draft files and six focus selections were retained; no error files were present.

Result #

Variant Median words Stops Fallbacks Generation calls
baseline 21.5 {'end': 4, 'length_limit': 2} 0 372
full_request 28.5 {'end': 4, 'length_limit': 2} 0 404
span_state 15 {'length_limit': 1, 'end': 5} 1 376
span_instruction 15 {'end': 5, 'length_limit': 1} 1 360

Among outputs marked end, median returned lengths are 13, 17, 11 and 14 words respectively (4, 4, 5 and 5 eligible replies). Eligibility is a stopping judgment, not a quality label. Long outputs are often failed generation, not useful delivered replies. Each length_limit result below is withheld by the decoder. Fallbacks return an earlier natural ending, so the retained generated steps can be much longer than the returned text.

All four story setups produced rough events. Duplicating the full request made the two story samples longer, but both music samples still degenerated into filler. Selected spans did not consistently improve breadth, relevance or substance: one bread run looped and another fell back to four words. No arm is a general length remedy. The bread outputs mainly say water leaves; none explains starch retrogradation, so being longer should not be confused with factual improvement.

The selected spans were “a very exciting story” for both story seeds; “why does bread go stale” for both bread seeds; and “you like about music” / “do you like about music” for music seeds 1 / 7. These choices mostly preserve the task already explicit in the original request.

Every draft #

baseline, seed 1: what do you like about music? tell me why #

60 words; stop length_limit; fallback None; 122 calls.

i love music because it is amazing honestly seriously literally everything haha lmao lmao lmao haha haha ha lmao lmao lmao haha lmao lmao haha ha ha haha ha haha ha lmao haha haha haha lmao ha lmao haha lmao ha ha lmao lmao haha haha ha lmao haha haha lmao lmao haha ha ha haha lmao lmao haha haha

full_request, seed 1: what do you like about music? tell me why #

57 words; stop length_limit; fallback None; 116 calls.

i like music because it is good actually honestly really amazing seriously great awesome cool everything etc and end end end end stop end end end end end end end end end end end end end end end end stop bye goodbye goodbye goodbye bye goodbye done done bye done done done stop end bye goodbye goodbye

span_instruction, seed 1: what do you like about music? tell me why #

14 words; stop end; fallback None; 30 calls.

i love music because it is great and fun listening and playing music especially

span_state, seed 1: what do you like about music? tell me why #

9 words; stop end; fallback length_limit; 126 calls.

i like music because it is good tho haha

baseline, seed 7: what do you like about music? tell me why #

63 words; stop length_limit; fallback None; 128 calls.

i like music because it is good music obviously lol lmao lmao lmao haha lmao lmao haha ha ha ha haha haha ha ha ha haha haha lmao lmao lmao haha lmao lmao lmao lmao lmao lmao lmao lmao lmao lmao lmao haha lmao lmao lmao haha lol lmao lol lmao lol lol haha haha haha haha ha haha ha lmao lmao lmao

full_request, seed 7: what do you like about music? tell me why #

64 words; stop length_limit; fallback None; 130 calls.

i like music because it is good music obviously lol lmao lmao lmao haha haha haha haha ha ha ha lmao lmao haha haha haha lmao lmao haha lmao lmao lmao lmao lmao lmao lmao lmao lol lol lol lol lol lol haha lmao lmao haha lmao lol lmao haha ha ha ha ha haha haha haha lmao haha haha haha lmao lmao lmao

span_instruction, seed 7: what do you like about music? tell me why #

63 words; stop length_limit; fallback None; 128 calls.

i like it because it is good music obviously lmao lol lol lol lmao lmao lmao lmao haha lmao lmao lol lmao haha lmao lmao lmao lmao lol lol lmao lmao lol lmao haha lol lmao lmao haha haha lol lol lol lmao lol lmao lol lol haha haha lmao haha lmao lmao lol lmao lmao lmao lmao lol lol haha lmao lol

span_state, seed 7: what do you like about music? tell me why #

11 words; stop end; fallback None; 24 calls.

i like music because it is good fun and cool tho

baseline, seed 1: why does bread go stale? explain what happens #

7 words; stop end; fallback None; 16 calls.

bread go stale because the water leaves

full_request, seed 1: why does bread go stale? explain what happens #

8 words; stop end; fallback None; 18 calls.

bread does go stale because the water leaves

span_instruction, seed 1: why does bread go stale? explain what happens #

4 words; stop end; fallback length_limit; 106 calls.

because it's dry actually

span_state, seed 1: why does bread go stale? explain what happens #

57 words; stop length_limit; fallback None; 116 calls.

because it's getting stale basically actually anyway er well uh anyway anyway uh anyway anyway anyway anyway er er er anyway anyway uh anyway anyway uh anyway anyway uh anyway er er uh uh anyway er er anyway uh uh uh er anyway anyway er er uh anyway er er anyway anyway uh uh anyway anyway anyway

baseline, seed 7: why does bread go stale? explain what happens #

7 words; stop end; fallback None; 16 calls.

bread goes stale because the water leaves

full_request, seed 7: why does bread go stale? explain what happens #

10 words; stop end; fallback None; 22 calls.

bread goes stale because the water in bread moves out

span_instruction, seed 7: why does bread go stale? explain what happens #

7 words; stop end; fallback None; 16 calls.

because the water leaves bread dry out

span_state, seed 7: why does bread go stale? explain what happens #

9 words; stop end; fallback None; 20 calls.

bread goes stale because the water in bread moves

baseline, seed 1: write me a very exciting story please #

19 words; stop end; fallback None; 40 calls.

once upon a time there was a dragon named storm suddenly appeared flying fast and landed safely then disappeared

full_request, seed 1: write me a very exciting story please #

24 words; stop end; fallback None; 50 calls.

once upon a time there lived a hero who was legendary and famous everywhere suddenly he was gone disappeared forever but suddenly returned again

span_instruction, seed 1: write me a very exciting story please #

16 words; stop end; fallback None; 34 calls.

once a time there was a hero who was brave suddenly attacked enemies and fought quickly

span_state, seed 1: write me a very exciting story please #

24 words; stop end; fallback None; 50 calls.

once upon a time there lived a hero who was legendary and famous everywhere suddenly disappeared but he returned again and he fought evil

baseline, seed 7: write me a very exciting story please #

24 words; stop end; fallback None; 50 calls.

once upon a time there lived a man called john who was brave and strong and suddenly happened something exciting and he did run

full_request, seed 7: write me a very exciting story please #

33 words; stop end; fallback None; 68 calls.

once upon a time there was a dragon named flash and he lived in the forest but he was fast flying and powerful suddenly he attacked princess but suddenly disappeared and then returned

span_instruction, seed 7: write me a very exciting story please #

22 words; stop end; fallback None; 46 calls.

once upon a time there was a dragon named storm suddenly attacked village destroyed but then a man came who killed dragon

span_state, seed 7: write me a very exciting story please #

19 words; stop end; fallback None; 40 calls.

once upon a time there was a dragon named flash and he was very fast and ran far away