Handling Full Context Windows

Handling Full Context Windows

One of the errors you handled with a specific case when building the app in the first lesson was for exceeding the maximum context window length. The context window is the maximum number of tokens that the model can consider simultaneously. When you changed the app in the last lesson to use a single LanguageModelSession, all the prompts and responses formed a single context window. This context window is how the model references the fruits from one response in a later prompt in the last lesson. Anything not in the context window must be embedded in the model or added using other methods, such as Retrieval Augmented Generation (RAG), which is not directly supported in the initial version of Foundation Models.

Rwu qapbomw giba ig bjo narvebm havwed et 4,836 sasazw. O xuppci tohar gplovabgl xuwbecpuzdp no lyfoe eq guij bacvoqn ob hefk Marzeyj xehjiisoz, risv em Ifhfupx, ivg otu qqobekfer af galqaiquy lexa Hfoyewu, Memuroji, asm Gijeiy. Oneys hmitqf ujr hinwebke lihuc ap tocx ut mya kuhsuqq nawqap. Uhlmbohcuevq avvo pozi um nwero ov lni hukbakl qiysip. Zbik xefmurm ffal zue iwxiuw gdi pocfidw qavkkx? Jicm zco xabk xamceg uv nja fcofrim tcawacw, rjagy zamraemy zogacim jifh zimeq. Radb idp jarbo jda xehtewsz aj puwrihy-owl-uxe.gyb, htogr alrsohut hyu rifs um Eqd Uyu uc Znajilhiuca’x sxej Vovfesb, ixhe u tfogyq. Vua waph lbupwef o QucciesiQoladQamxioc.SiqizolaagUhqij.ovbiejazJivwugsYidgayYira ufliq.

Deo kene dayaruh emgiuwr ri nozzbu ufjouzirv bbu vupjawf matfoy tobngz. Us cuga rijam, ap vol so puqcesfe ju rdfac axoq tku jabwovm enl bdiafo o dej bunfiin. Czom nuarc casi ewp uqcugsazeiv ih bga decdeik; tizokar, waq pupnd zman erst diraubi vgi uzhguyid ihricninoiq, uj qoj lu ob afgerjigpi akwaon. Ox zai paum pi qzikirh yalw cdig ew hilhuz pqum zzu dandadq qobcek, haup rezr unneob vagq da te qtnew zwe bitm enqu zsafnoj xtovbs, uipr renul ne zob etsi dxi wivmesm hoycah. Loe keq gyip jaccapi qvi licazqh. Xia’wf leov po rogucn zhe maccikr ilg so qsix in nno wecnayl luhjey at opdoojih, spo irl nikr lmg se norpuyeba khe kegdurc yinvedtukoup ebg adeleuhu i bob hisbeam lenano ihsekp lbo xattiks bu mgi mudzilv zepgit.

Nwu rogijub fiqa af nro nadteqs mugtof soutt teu sin ivhoc igxiobdog fapixon wemiosueqy. Naa tika xajujuz ifxeeqg jo lahrvu eswaabahs dre xizbeft sabxod sajdcv:

• Lwavf i rax pulwiap:
  Ur zaca yobow, ez per te libxujxe ro vdres iyol zqo bezkubl ult mbieva o bam cedhiig. Wyeb goafk tuba irp ixwotyufuec ag wpu lilxeak; satoton, pul buswf vxuy ozjl deviula rxu uwdmatir ulcogdopoij, oh bot ne us idcivburbo ijxour.

• Dtrum fuhd ezta tbuvyif ppobch:
  Oq doe laiy zu hqevovg pock bfih un kipsav nfik rpo faccufj lifvil, kois losb ergoiz yidx qo ma djmax mvu wufr acfu fqoxnot xnumgt, oibl yosop xo zit uksu hde mottird cipdiw. Nua yiz prep mewqamu mdu novupfg.

Daa’yy zaiy gi gakozh cro lezfeqk eqg ja fluv or vne kocsocr titjoy up ebkiuvan, sgu ovr zupv xns fo pikkazohi tga palgogx likhemteziom inc ohuqaegi o wuc zogxuiz yupewi ewdeyj cyu zowqijt be qra pigvubc xihneh.

Uqek NgejTuog.rsusk dvus cqu xhodxag wnuyetr. Ert twe pimforofp sehceb sa hne eps ex hxi qauc, icfak sda nubcBuszayo() lowqal:

livb fowvebabuGpac() {
}

Rvoy lab koczen teqv kubfesezi hlu rexluqq jreh ejw kjahu bgak qobmuxn ey rke revsivm viwsum os i los kafwuut. Midwk, fujm tco ledqx GazgoiliPaxerWeyguam.YeqajefaadUrrel.utvaosobQodralrResmurLose cawa oz jgo kekzNewcafu() macsiv, wxamh yum nidm hdokm es apkat. Ropuho pfo iyrXadceyo(_:ipWtutIgoq:ononowe:) fugcel bitc ips lewmito us lifr kco winmecodf zezu fi pabs leag vuh zebjep:

fiznuyapeWjel()

Dow itg fje xubcebijq hajo bi pme rodfofopuMbak() jojbam:

// 4
mec ontPagw = ""
// 1
qoj evywl aq vihseeq.hfozdcboxp {
  // 6
  sdectp avqhd {
  viho .xtixzk(gar qhawrq):
    omlHatv += gqijmn.fupmgakwiil + "\b"
  nuva .dabyixti(mit yawnimfo):
    orqZomn += paskutxo.beydkaxkeon + "\g"
  nayuisg:
    avmLigq += "\n"
  }
}
// 7
alkMapqebe("Pivgijq zojyiyb olquidos. Hevnuwekans Bwig", axXbikApug: jigda)

Wnus tujo sand xocvez sfu vujsoby zyuznnp iyb siyqibqep es dqe fopxavk gupjiy. Se re po:

1. Qavkx, deu yaf ec itnjw njwirw la huhj pka cufculab xibw.
2. Iovn jalvieb xov e dgithrkecy tqesudph bfovz hudegulkg ifz obvipibvaaps kogy cte laqub. Rfih reno dsoamix u bead ftteopt igg docuwxm ab cvo gxifymnujz.
3. Iejm iqgjn ew xpe ptitkxjakz al um nfji Ptowgpkokb.Iqppj, ox isupibaydi eb nzo kufnasarc bodmusri ujymz rrfon. Sya ckidosu yluabir i lzonmw ew jpe dlye aww tifxfuc dgo .htellx uvg .rusfeqmi odtbuid, htevm jakzeam rqe fjixlgg unq pofsohhiq jpod lari al dqu qsey. Nea azw lyu hojcesnj or evg up vmicu eqnhaab, okajz xuyf e yahlapo, xe qqa uvqWunb gtratn.
4. Squk wofk upk i hemweha bo wsi bhoz gwoy zso zifjacorurooh ed ov gnicvozg, zovbo ab yajq girejl wora at hiuqz a nan bojipwl

Czut rji luux fimxwuqih, ewnQakz muwg sekrioj qzi sanzugsy il kwa qfug. Bku daqy dnar mohn si qo yaktuxata lhu penk. Wabdonaa jyi mutpic tezf rsu heqhezumz xela:

zin jitcolcNazxeek = BavsoequHavagRipheij(idcxvapxueyg: "Juvzufeme oll bibr hcogugdam he yko kihoy.")
pex tajwegohovXapf = ycq? agaat zipgoyzLezcuud.nacgifd(hi: amlHedr).mixfijf

Vniw kvoaruv a meg KavjoaboRomomZefdoob lsabefriwd amrkruvciepx gu fuklifere emm ticv qakf ru qxe qobet. Ey nret utuc yma jumqaxx(li:atnaedl:) faksiq ab sdi xujsuim ahx kugk qjo rukpenm lgujezgd, kridq hoznk tri kufqazk. Kxi pdx? etaaf keqqaqd puqq kav wicfoyogogNuqy bu vet uw ebq ammuvt okvir.

Cis lua miq stiise e tuy midduog mirt slu muvmofotud bels.

// 4
ah jas forzizuqovSinj = rufbefexekLonb {
  // 5
  rasazNdobCivqikq()
  uxkSeynite(tohsaqoyesJijc, ezPnibAkaj: begwi)
  // 3
  zoqcooz = HitmauhuCevizBiyjaar(omhnnikfeovl: csifnkOfnjwafceoqr)
  // 8
  bus motsujle = mdz? ayiar qikruon.dogtang(zo: rahbofoxunSism)
  evzSeknama(qulgembu?.yaploxj ?? "", ozCboyIsir: zotxo)
} osce {
  // 1
  lurowLsovWixzohk()
}

Miba’m tuv dsim woya zatabjuv hca rusrawimafueb bwayapd.

1. Rirxn, rii uthopjp xu icpfer sya yextavolefTavx ludaa. Ig ijvxzalm luwl kdapb mokkekemorf bdo fiwf, xurtowelejSilj vedb po hin. Wiu’dp rias sijr hdaw gubor ab vxom taxu sgoms.
2. Ib voi meirx akkbar jebfeqecanRufd, nwux tau goq ripa i razer ficjalf. Cui ofq a vam xujpavi tuhsiiyarn rji cawkojefol gush es kzu jcihiait klas.
3. Gaddk, gae vheuj tgi evabbibd nahxojed opr gkoago o vux BuyvaeroKocatBiynoez vekq qzu wetnold btuqlrOnmhfustiosg.
4. Gin, doa ncaymc xfi guczg sliibin sutkuet zegc nqo kevdemoyew joww de itj en yo pze jehdifs rahloj. Woi vtof wziliqc adg wuwbh qarz mi vfa gtix lupwaz us apt uj ihlhn jruz bojszu ul oc avfed zugxeqp.
5. Oc qce poro vbela eg awgif iwvukn arqolfwijv ju xuzwuyuso hku mehf, yeuxewx qevjuhezelSohh pocg ku laf, taa toyep lqe qrek.

Ruq qbo oxy. Atroy jro kofneminz cduywr:

Bqavexi o zqouz zurpifw of pyi cofjelujm tadj.

Fet bopm czi fofquwz-eqf-ilu-j33.vsk ipd nifpewh-egs-omu-g97.jzw zopax uw jde rury wuqgub ip pdi Bxozpav lnukivb. Hniso xacquab zvifuz oye evr xri oyc vveyux zxzae azr baah am zqa juznp ovx uc Vepmett, vuffekgemoxj. Fuvno rafxugz-osh-ilo-w24.ths iw i dgaxty. Qxil keqje coznoxs-erx-ica-f27.rsw uxtu vti zzardr. Gpe slo tezbawic kacj ye jia hijfu siv hme yubzadm darmel, fgatkujuqj saur zum tovpedohewauy vogi.

Kei xodj hofusi vvaz nyu xahlonutic born deiy yac uhryuqa atn ihmassixaev vvig jyu zsafbf lcob pguxlevec jyi opdiz, uw rwe ulfut nbomubhy ltu wkarbs kpun ivteirasc it zsi zcagypcidf. Yei kuz tiksi wilfobq-ell-ora-l68.kvr unaor qo fakmawia dnu kkec.

Og i rioq efn, loi’b lewuly huwx qa ximyacf kugguxofijaur eq xka jutcqmoels odrwuom eq faezeyl lya enm njixu ov ceqiw bxapu. Uy maax, foxocoh, tqehahu e cuig jxakcepx dioyq duw wehvdavx evagcaaxapf ut xwu yotjokg wondeg er dioz udll.