AI Systems

                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                 .:dO0KXK0kl'                                                           
                                                                                                                                                                                                               :XMMMMNKKXMMMMk.                                                         
                                                                                                                                                                                                               lNWk:.    .kMMMd                                                         
                                                          :oooool:'.          ,llc  ;oxkxdc.        lll' .cdkkxo;.      .llllll.  ,oxkxo:.        .:oxkkdl;        clll.         ,lll'       .;loddoc,          ..        cMMMx                                                         
                                                          XMMMMMMMMW0:        oMMW;XMWNNMMMMK,     .WMMddMMNNWMMMWd.    :MMMMMMo.KMWNWMMMN,     ,0MMMMWMMMMWd.     :MMMk        .NMMK.     ,OWMMMMMMMMWx.                ;NMMN.                                                         
                                                          ......':kWMMk       oMMMWx'   .:NMMW,    .WMMWX:.   'kMMM0     ...KMMOxO,   ,WMMK    lMMMX:. .'dWMMX.     xMMM:       kMMW'     lMMMO:....:KMMN.            .dXMMMk.                                                          
                                                                   :MMM;      oMMMx       .WMM0    .WMMW.       dMMMl       KMMMx      dXXK.  'MMMX.      :MMMO      0MMN.     ;MMMo     'WMMo       .0MMx           :WMMKc.                                                            
                                                          .;ldxkkkxkMMMl      oMMM,        kMMW.   .WMM0        .WMMk       KMMM.             oMMMl        XMMW.     .WMMx    .XMMO      oMMWc;;;;;;;;xMMX           NMMk                                                               
                                                        ,OWMMWXXKKKNMMMl      oMMM,        dMMM.   .WMMO         NMMO       KMMN              dMMMc        KMMM.      lMMW,   kMMX.      dMMMMMMMMMMMMMMMX          .KXX;                                                               
                                                       .WMMk'      'MMMl      oMMMc        0MMN    .WMMX        'MMMx       KMMX              cMMMk       .WMMX        OMMK  :MMM;       :MMMc............                                                                              
                                                       cMMM'      .OWMMl      oMMMX.      oMMMd    .WMMMo      .KMMM,       KMMX              .KMMMl     .OMMMc        .XMMd.XMMd         0MMNc.                     ;lc.                                                               
                                                       .NMMNdc::lOWOdMMXkx;   oMMMkWOollxXMMMO     .WMM00NxlloOWMMW:   .kkkkWMMWkkkk:          .OMMMXxddOWMMWc          ,MMMKMMX.         .xMMMW0xollloxc           0MMMW,                                                              
                                                        .dXMMMMMMKl lMMMMMx   oMMM,:KMMMMMWO:      .WMMO.xNMMMMMXd.    .WMMMMMMMMMMMo            ;kNMMMMMWKo.            dMMMMM,            .lONMMMMMMMMX           oWMMK.                                                              
                                                           ..'...    .....    oMMM,  ..'..         .WMMO   ..'..                                    ..'..                                       ...''''..            ...                                                                
                                                                              oMMM,                .WMMO                                                                                                                                                                                
                                                                              oMMM,                .WMMO                                                                                                                                                                                
                                                                              oMMM,                .WMMO                                                                                                                                                                                
                                                                              ....                  ....                                                                                                                                                                                
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                      ..             ',                                        ..  ..     ..                                        ..                                                    ..                                                            
                                                      ,o,,'   ',,. .ld; .,;,. .',' .,,'     .,,'  ,.,;. ..   '.dl, c:,;'  ,. ,.,,.  .,,';    .,,.  .,,'  .',;'   ',,o; .,,.     ';,. .'',   .,,,. '.,,.  .,,'  .',;'   ',,o: .,,'                                                       
                                                      ,d  'd dc..d, ;: .d. .d.,x. 'x'.;x    ;.'d: O; .d..x. o, l,  co  lc l, O' .x.'d. 'O.  .x'.,.'x'.;x co  lc x, .d;.k,.,.   x. .o'.k.    oc.'' x,  l:'x'.;k.:o  cl d,  o: x,.,.                                                      
                                                      ,o  .x d:..:. ;: .d   d',l  'x'.':   ,o..oc O.  c, .oc:  l;  c;  'o l, x   o,'o  .O.  .'.'o',x..,: c;  'o k.  o;.'.'o,  .x.  l,.d     '..:o d'  cc'x..'c :;  .x d.  l: '.'l;                                                      
                                                      .;;;;.  ,;;'  ..  .;;;. .'   .;;;.    ;,,'' c   '.  ;o   .:; '.  ., ,. :   ,. .;;:0.   ,;;;  .;;;. '.  .,  ;;;;. ,;;,    .;;;. .;     .;;;. x:;;'  .;;;. '.  .;  ;;;;. ';;;.                                                      
                                                                                                          l.                        ;;;c;                                                         l.

Agent Middleware: What Kept Obelisk's Agents in Line

Obelisk is the AI marketing platform we build at Entropy Labs. It runs more than fifteen specialist agents: brand voice, SEO, email, paid ads, strategy and so on, all behind one API. Writing an agent turned out to be the easy part. The hard part was everything wrapped around each model call: which model to use, what to do when the conversation gets long, how to stop an agent calling the same tool forever, when to ask a human before spending money, and what to do when something fails. Early on, each agent handled those things its own way. That didn’t last. ...

                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                  'cdxkkxd:                                                                                                             
                                                 ;::,                                                                                                          .dNMMMMMMMMd                                                 'lxOKXXKOxc.                                                
                                                .WMM0                                                                                                         .XMMWd,.....                                               .dNMMMMXKKNMMMWc                                               
                                                .WMM0                                                                                                         kMMM;                                                      .xWNd,.    'XMMW'                                              
                                            ;llloWMMXllllllll'    .llllll.  ,oxkxd:.      ;oooool:,.          .lll. ,oxkkdc.           .,clddxxxxxd.          NMM0                .,coddol,.        llllll,  .lxkkdc.      ..        kMMM,                                              
                                            kMMMMMMMMMMMMMMMMo    :MMMMMMo.OMWNNMMMN;     OMMMMMMMMMKl.       :MMM;0MMWMMMMMO.       lKMMMMMMMMMMMM'         .WMMO              'kWMMMMMMMMWk'     .WMMMMM0 xMMNNMMMWo             .oMMMk                                               
                                            ....'WMM0.........     ...KMMOd0,   ,NMMN.    ......';dNMMK.      :MMMNO;.  .dMMMO      dMMM0:'........     ccccclMMMKccccccc.     ;WMM0:....;0MMW,     ...xMMWlK;.  .0MMM'          ,kWMMNl                                                
                                                .WMM0                 0MMMO      oXXK'             .WMMl      :MMMk       OMMW.     OMMMl.             .MMMMMMMMMMMMMMMMMl    .NMMx        kMM0        oMMMX.     ;XXX;         xMMMk:.                                                 
                                                .WMM0                 0MMM'                ,coxkkkxdWMMx      :MMMc       kMMW.     ,XMMMWXOxl:'.       ''''';MMM0'''''''.    cMMWc;;;;;;;;xMMM.       oMMMl                   ;MMMc                                                    
                                                .WMM0                 0MMN              .xWMMWNXKKKXMMMx      :MMMc       kMMW.       'cdOKWMMMMW0l.         .WMMO            lMMMMMMMMMMMMMMMM.       oMMM;                   ;XXX.                                                    
                                                 NMM0                 0MMX             .XMMK;      .WMMx      :MMMc       kMMW.             .':OMMMk         .WMMO            ,MMMl............        oMMM,                                                                            
                                                 0MMW:                0MMX             ,MMMl       oWMMx      :MMMc       kMMW.                'WMMK         .WMMO             xMMWo.                  oMMM,                   .cl:.                                                    
                                                 'NMMMXkdoddxd    kkkkNMMWkkkkl         KMMWxc::lkNXoMMNkxl   :MMMc       kMMW.     dOkxddoddkKMMMWc         .WMMO              oWMMW0xollloxo     okkkXMMM0kkkd              .NMMMX                                                    
                                                  .l0WMMMMMMMW.  .WMMMMMMMMMMMk          lKMMMMMMXd.;MMMMMK   :MMMc       kMMW.     XMMMMMMMMMMN0o.          .WMMO               .lONMMMMMMMMW.    KMMMMMMMMMMMK               OMMMx                                                    
                                                      ..''....                             ..''..    ......                          ....'''...                                      ...''''..                                  ...                                                     
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                           ..                                                             ..  ..                                                                                                        
                                                                                          .''' .,,,. ,.  ,.'.  ',,. .. .;  ..        .,,', '.  ..  ,,,. .',. .,,'  ,.,,. .dl, '' '.,;.   ',,.                                                                                           
                                                                                          ,k. 'k,.,x.'o 'o c; x;.'x'.o ld, d    ,   ;o. 'x d.  ;l ',.:O :d. .;.'d: O' .x. l,  :c x: .d;.k;.'k.                                                                                          
                                                                                          ,o  'k'.':  ::d  c; k,..:. coc oo,    .   :l  .x l:  ll d;.,0.::  ;l'.oc x   o, l;  :c x.  :c.k,.'c.                                                                                          
                                                                                          .,   .;;;.   :.  '. .;;;'   :  .:          ';;;x  ;:;,' ';,'; .'  .;,,'' :   ,. .:; .' ;.  .' .;;;.                                                                                           
                                                                                                                                         l

Scoring Fraud in Legal Intake Calls

Mass tort firms run intake lines that take a lot of calls from people who may qualify for a case: they took a certain drug, had a certain device implanted, lived near a certain plant. Some share of those callers aren’t who they say they are. Some are coached and reading from a script. Some never used the product. Some call back under a different name. RISQ listens to those calls, scores them, and recommends one of three things: send the caller on to a closer, flag them for a human to review, or quarantine the call. This post is about how the scoring works in principle. The actual weights and thresholds belong to the client, so they’re not here. ...

                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                 .:::::::;                                                                                                                                                              
                                                                                                                 .MMMMMMMK             .ccc                                                                     ;000. .000,        k00l  d00x                                           
                                                                                                                  ....lMMK             .MMM.                                                                    :MMM. .MMM;        KMMd  kMMO                                           
                                                  ...           .....               ......                            cMMK             .MMM.                                                                    ;MMW. .WMM,        0MMo  xMMk                                           
                                        ;WWWWWc dNMMMW0;     ;kXMMMMMXx,       'd0XWMMMMMMN.    kNNl      ONN:        cMMK         'NNNWMMMWNNNNNNo                      0XXXXXXXXXXXXXX:                       ,MMX   NMM'        OMMc  dMMx                                           
                                        .ccxMMOoO:''oMMW.  .OMMKl,',lXMMl     :MMWkl:;;;;;,     OMMl      KMMc        cMMK         .cccdMMMocccccc'                      cllllllllllllll'                       .MMK   XMM.        xMM:  lMMd                                           
                                           :MMWd     xXX:  dMMx      .KMW.    kMM0.             0MMl      KMMc        cMMK             .MMM.                                                                     ...   ...         ...    ...                                           
                                           :MMM.           KMMxlllllll0MM:    'KMMMN0ko:'       OMMl      KMMc        cMMK             .MMM.                             ...............                                                                                                
                                           :MMN            KMMKOOOOOOOOOO'      .;ldOKNMMWx.    OMMl      KMMc        cMMK             .MMM.                             NMMMMMMMMMMMMMMc                                                                                               
                                           :MMN            oMM0.                       .NMMd    OMMo     .WMMc        :MMX             .MMM'                             ,;;;;;;;;;;;;;;.                                                                                               
                                        ,;;dMMW:;;,         dWMNxc,''',;.     ';,''..';dWMMc    lMMNl'.'lOXMMx,.      .WMMk;'.';'       kMMXl,'.',,                                                                                                                                     
                                        XMMMMMMMMMX          .o0WMMMMMMMl     0MMMMMMMMMWO;      lXMMMMMO.kMMMMd       '0MMMMMMMk        cKMMMMMMMM.                                                                                                                                    
                                        ...........              ..''''.      .',,;;;,'.           .,;,.  .''''.         .,;;,'.           .',;;,'.                                                                                                                                     
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                                                                                                                        
                                                                                                                                                                                     .   .                                                                                              
                                                                                        ',,. ..  .'  ';,.  .,;'  .,,,.  ',,.  ',,.       .,,'  '',;.  ,',,.  ',,.  '',  ',,. .'';,  ,O:' o...   ,                                                                                       
                                                                                       ;o..; l,  ,o o;  ,.;l  '..x,.'x.,d.., ;o..;       ,..lo d:  c:.O. .d..;.'k,.k. .k;.'k.,k. ,x  k.  o..x. o,                                                                                       
                                                                                       ...,x.:c  :o d'  ' :c  ...k'.': ...,d....,x.     .o'.cd d,  :c.k.  d.cc..x;.d  .k,.'c.,o  .0. k.  o. .oc:                                                                                        
                                                                                       .;;;,  ,:;,,  ,;;'  ';;;  .;;;.  ;;;, .;;;, ;;    ,,,', dc;;, .O,;;. .;,,'..;   .;;;. .,   c  .:' ,.  ;o                                                                                         
                                                                                                                                   .           l.    .o                                      l.

LangChain in Production: What the Tutorials Leave Out

Every LangChain tutorial ends where the real work starts. A tidy script queries a PDF, you think you’ll ship it by Friday, and a few weeks later you’re working out why a chain returns an empty string with no error. I’ve shipped LangChain-based features at WebNoodle and at Entropy Labs, and we still use it for Obelisk’s agents. So this is about where I’ve found it pays for itself, and what I now do by default when it does. ...