jPdZddlmZddlZddlZddlmZmZddlmZddl m Z ddl Z edZ edZ d Zd Zd Zd Zd ZdZdZdZdZdZdZdZdZ d$ d%dZd&d'dZd(dZd)dZd*dZd+dZ d,dZ!d-dZ"d.dZ#d/dZ$ d0 d1d Z%d2d!Z&d2d"Z' d3 d4d#Z(y)5a Modulo "Funil WhatsApp PX3". Puxa conversas WhatsApp do Linkia PX3 (GHL) e monta o funil: chegou -> conversou -> reuniao marcada -> venda -> perdido. Classificacao em 2 camadas (SEM IA na v1): 1) opportunity + pipeline stage do GHL (dado explicito da vendedora). 2) heuristica de palavras-chave nas ultimas mensagens. Expoe: - buscar_conversas_whatsapp(headers_conv, location_id, since_ms, until_ms) - buscar_mensagens(conv_id, headers_conv) - classificar_conversa(conv, pipelines_meta, msgs_cache=None, headers_conv=None) - montar_funil(conversas, pipelines_meta, inicio_br, fim_br, enriquecer_msgs=True, headers_conv=None) ) annotationsN)datetime timedelta)ZoneInfo)IterablezAmerica/Sao_PauloUTCz$https://services.leadconnectorhq.com) ganhamosganhoganhacomprouvendavendidofechadpagoclienteganhou)perdidperdemosperda desqualificinvalidznao vaiznao responderamz sem resposta)reuniaozreuniao diagnostico diagnosticoagendadagendou agendamentoz demo agendadacallmeeting qualificado qualificacaopropostanegociaz com consultor)z em conversa conversandozrespondeu mensagem contatado)z novo leadzrecebeu a mensagemzrecebeu mensagemz novo contatonovoleadwonlost abandonedopen)agendei agendamosmarqueimarcamosagendadomarcadoz amanha aszhoje aszoomz google meetz meet.googlezreuniao marcadazpodemos marcarz vamos marcarz te chamo asz te ligo asz ligamos as) pagueizpagamento feitoz paguei agora comprovantez fiz o pixz pix feitoassineifecheicompreiz sou clientez assinatura okc g}t}d} d} td|dz } | |kr| dz } ||dddd} | r| | d < tjtd || d } | j }| jd k(r)|r|jdtjd| jdk7r5|r0|jd| jd| dt|dd |S |jdxsg}|s |Sd}|D]d}|jd}|r||vr|j||j|t|jdxsd}|||ksc|}f|d}|jdxsg}|r|dnd}|r|| k(r |S|} |r|| kr |Stjd| |kr|S#t $ri}YgwxYw#t $r!}|r|jd|Yd}~|Sd}~wwxYw)a Pagina /conversations/search com lastMessageType=TYPE_WHATSAPP, ordenado por last_message_date desc. Pega SO as conversas cujo `dateAdded` (criacao da conversa / chegada do lead) esta dentro de [since_ms, until_ms]. Como o sort e por last_message_date, a gente para quando `lastMessageDate` cair abaixo de since_ms E ao mesmo tempo `dateAdded` tambem (margem de seguranca: paginamos ate `lastMessageDate < since_ms - 90d` ou acabar). Dedupe por conversation id. NrlX TYPE_WHATSAPPlast_message_datedesc) locationIdlimitlastMessageTypesortBysortstartAfterDatez/conversations/searchheadersparamstimeoutiz"funil_whatsapp: 429, aguardando 2szfunil_whatsapp: z params=z data=zfunil_whatsapp: erro request conversationsidlastMessageDaterA皙?)setmaxrequestsgetGHL_BASEjson Exception status_codewarningtimesleepstraddappendint) headers_conv location_idsince_msuntil_ms max_pages page_sizeloggerconvsvistoscursorpaginassafety_floor_msrFrdatae page_convslast_message_date_minccidlmd last_itemsort_arr new_cursors >/opt/mia/workspace/clientes/px3lab/dashboard/funil_whatsapp.pybuscar_conversas_whatsapprv]s{(EuF FG!X(==>O I 1 %.)   '-F# $  *12$ A vvx}}#NN#GH 1 }}#NN*1==/&PSTXPYZ^[^P_O`aF LQ$XXo.4"  6 L3!% ,A%%+C#- JJsO LLOaee-.3!4C$,6K0K(+% ,rN ==(.B$,Xa[$ Z61  L !%:_%L  L 3G I J L_   !>qcBC > LE sB GG,7G$AG GGGG H G<<HcP tjtd|d|d|i|} |j}|j dk7rgS |jd}t |tr|jdxsg}|xsgS#t$ri}Y[wxYw#t$rgcYSwxYw)zc GET /conversations/{id}/messages -> ultimas N mensagens. Retorna lista ou [] em erro. z/conversations/z /messagesr>rDrImessages)rQrRrSrTrUrV isinstancedict)conv_idr^r>rGrjrkmsgss rubuscar_mensagensr}s  LLjy : U#    668D ==C I 88J D$xx #)r :2 D   s3%BBB BBBB B%$B%c|syd}|}|D]\}}|j||}|jjS)N))áa)ãr)âr)àr)érl)êrl)íi)óo)ôr)õr)úu)çro)Ár)Ãr)Âr)Érl)Êrl)Ír)Ór)Ôr)Õr)Úr)Çro)replacelowerstrip)sreploutrbs ru_normrsO  DD C 1kk!Q 99;   c:t|}|sy|D]}||vsyy)NFT)r)txttokensttoks ru _match_anyrs/ c A  !8 rc|jd}|jd}|xsij|xsi}|jdxsi}|j|dS)zDpipelines_meta = {pipeline_id: {name, stages_map: {stage_id: name}}} pipelineIdpipelineStageId stages_maprrR)opppipelines_metapidsidpmsmaps ru_stage_name_from_opprs] '', C ''# $C  B # #C ( .BB 66,  %2D 88C rc|syd}ddddd}|D]"}t|ts|jdxsd j}t ||}t |}|xsij|jd xsijd xsd }d} |t k(st|trd } nFt|trd } n3|ttfvst|trd} nt|trd} | |j| d} |d|xsdd|d} | | |dkDs| | | f}%|r |d|dfSy)a Retorna (categoria, motivo) baseado nas opportunities. categoria in {venda, perdido, reuniao, conversou, None} motivo = string curta (nome do stage + status). Regra de prioridade entre MULTIPLAS opps: venda > reuniao > perdido > conversou > nada (um lead que ja comprou NAO conta como perdido mesmo se tiver outra opp perdida; e uma reuniao avanca mais que um "perdido" em outra pipeline). NrNrHr9)r rperdido conversoustatusrrnamer rrrrz / ?z ())ryrzrRrrr STATUS_WONrSTAGE_TOKENS_VENDASTAGE_TOKENS_REUNIAO STATUS_LOSTSTATUS_ABANDONEDSTAGE_TOKENS_PERDIDOSTAGE_TOKENS_CONVERSANDO) oppsrmelhorRANKrr stage_nome stage_norm pipe_namecatrankmotivos ru_classifica_por_oppsrsf  F1 CD)#t$ ''(#)r002)#~> :& $*// 0EFL"QQRXY_]_  Z :j:L#MC  $8 9C  %56 6*ZQe:fC  $< =C ; xxQ;c*"3!4Bvha@ >TF1I-C(F1)4ay&)## rc|xsgDcgc]}t|tst| }}|sydj|t fddDryt fddDryt fd d Dry ycc}w) Nr c3&K|]}|v ywN.0rblobs ru z'_classifica_por_tags..3s S19 S)rrz venda-feita venda_feita)r ztag:cliente/vendidoc3&K|]}|v ywrrrs rurz'_classifica_por_tags..5s P19 Pr)zreuniao-marcadarreuniao_marcada)rz tag:reuniaoc3&K|]}|v ywrrrs rurz'_classifica_por_tags..7s 819 8r)rr)rz tag:perdido)ryrZrjoinany)tagsrtgsrs @ru_classifica_por_tagsr.sy"jb @Z3-?58 @C @  88C=D SR SS- PO PP' 87 88'  As B Bc|syg}|ddD]>}|jdxs|jdxsd}|s.|j|@dj|}t|tryt|t ry y) zN Olha as ultimas ~5 mensagens (as mais recentes vem primeiro no GHL). rNbodycontentrr)r zmsg: palavra de venda)rzmsg: palavra de reuniao)rRr\rrMSG_TOKENS_VENDAMSG_TOKENS_REUNIAO)r|corposmrrs ru_classifica_por_mensagensr<s  F "1X uuV}6i 06B  MM$   88F D$()/$*+3 rct|jdxsd}t|jdxsd}|sy|r ||dz k\ryy)aj 'Conversou' = o LEAD respondeu DEPOIS que a conversa foi criada (dateAdded). Essa e a leitura correta no GHL de prospeccao ativa. GHL mantem `lastInboundWhatsappMessageDate` historico (de qualquer resposta passada do contato), por isso NAO basta checar se o campo existe. Precisa estar temporalmente dentro desta janela de atendimento. lastInboundWhatsappMessageDater dateAddedFi`T)r]rR)conv inbound_ts date_addeds ru _has_inboundrPsPTXX>?D1EJTXXk*/a0J jZ&%89 rc,|sytd||z dz S)NgeAgpA)rP)ts_msagora_mss ru _dias_desderds  sX%*:; <14d atras -> 'perdido'.  opportunities)r rT) categoriarconversou_flagrr)r rrrKN )r>rNrLrzsem resposta >dFrzlead respondeuchegouzdisparo sem resposta) r]rXrrRrrr}rYrr DIAS_ABANDONO)rr msgs_cacher^enriquecer_msgsrrrrrcat_tmotivo_trpr|cat_mmotivo_m last_msg_mss ruclassificar_conversar js*23tyy{T12HT"I 88O $ *D&t^Nbfgg"V-M7Maf ggrc|sy tjt|dz t}|j dS#t $rYywxYw)Nrr)tzz %d/%m %H:%M)r fromtimestampr]TZ_BRstrftimerU)rdts ru _fmt_data_brrsI   # #CJ$5% @{{=)) s7= A A cx|sydjdt|D}|syt|dvrd|z}|S)Nrc3BK|]}|js|ywr)isdigit)rchs rurz"_sanitize_phone..s;BbjjlR;s)r 55)rrZlen)rawdigitss ru_sanitize_phoners@  WW;#c(; ;F  6{h Mrcttjdz}i}dddddd} i} g} |xsgD]} t| jdxsd} | s%| |ks| |kDr0t| |||||}|d}| dxxdz cc<|d s|d vr | d xxdz cc<|d k(r| d xxdz cc<n%|d k(r| d xxdz cc<n|dk(r | dxxdz cc<d}| jdxsg}|rt |t rt |d}|s| jdxsd}|xsd}| j||dddddd}|dxxdz cc<|d s|d vr |d xxdz cc<|d k(r|d xxdz cc<n%|d k(r|d xxdz cc<n|dk(r |dxxdz cc<| jdxsdjxs'| jdxsdjxsd}| jdxsd}t|}d}|r(| jdrd|d| jd}| j| jdxsd| jdxsd||||rd|nd| t| t| jdxsdt| jd||d||dd }|| d | d|| d | d || d | d || d | d|| d| dd!}t| jd"d#$}| jd%d#$| d| d | d | d | d||| d&S)'z conversas: lista BRUTA de /conversations/search (filtra aqui por dateAdded no periodo). pipelines_meta: {pipeline_id: {name, stages_map}} rr)rrrr rr)rr^rrrrr9r)rrr rrr rr followers assignedTosem_atribuicao)ghl_idrrrr r contactNamefullNamezSem nomephone contactIdz#https://app.linkia.app/v2/location/z/contacts/detail/rKzhttps://wa.me/rLr)r{ contact_idnome phone_raw phone_digitswa_urldata_entrada_msdata_entrada_br ultima_msg_ms ultima_msg_brestagior vendedora_id linkia_urlc,|sytd|z|z dS)NrgY@r9)round)numdens ru_pctzmontar_funil.._pct6sUS[3&**r)chegou_para_conversouconversou_para_reuniaoreuniao_para_vendachegou_para_venda pct_perdidoc |dS)Nrr)vs ruzmontar_funil..Fs akrT)keyreversec&|jddS)Nr)rr)rjs rur<zmontar_funil..Ksaee,=q&Ar)rrrr rtaxas por_vendedoraleads)r]rXrRr rylistrZ setdefaultrrr\rsortedvaluesrA) conversasr inicio_msfim_msrr^r_rrpor_catrAleads_detalhesrodt_addedclsrr.rr;r%r&r'r/r4r@vendedoras_listas ru montar_funilrOs499;%&HJq1QRSG%'M!#N _"V quu[).Q/  i 8f#4 # ~!%+  + Q  C+L$L K A % )  I ! #  G^ G  !  I  I ! #   EE+&," It4y|,L55.4"L#7'7  $ $\"aAa4   ( q  C+L$L kNa N )  iLA L G^ gJ!OJ I  iLA LUU= ! 'R . . 0 j!'R..0  EE'N(b &y1  155-5k]BS55%&(  uuT{(b%% ,2"(9E|n52'+H5 '8!9!>Q?)!%%0A*BC(m($  OV r+ "&gk&:GHr]rGr]rQrR)rrZrQrZ)rrZrz Iterable[str]rQbool)rrzrrzrQrZ)rrRrrzrQtuple[str, str])rrCrQrV)r|rRrQrV)rrzrQrU)rr]rr]rQfloat)NNFN)rrzrrzr dict | Noner^rXrrUrz int | NonerQrz)rQrZ)FNN)rGrRrrzrHr]rIr]rrUr^rXr_z str | NonerQrz))__doc__ __future__rrerXrrzoneinfortypingrrQr TZ_UTCrSrrrrSTAGE_TOKENS_RECEBEU_SOrrr STATUS_OPENrrrrvr}rrrrrrrrr rrrOrrruras"# ( $% % 1          ____ _  _  __D< -` ((=# $! Dh DhDhDh Dh  Dh  Dh DhT " $"MMMM  M  M  MM Mr