Issue when trying to create an external table

Question

Im trying to create an external table using the code below:

CREATE TABLE raw.loan (PARENTACCOUNT varchar(1000),ID varchar(1000),CHECKDIGITS varchar(1000),NOTENUMBER varchar(1000),TYPE varchar(1000),LASTFMDATE varchar(1000),LASTTRANDATE varchar(1000),ORIGINALDATE varchar(1000),OPENDATE varchar(1000),CHARGEOFFDATE varchar(1000),CLOSEDATE varchar(1000),REFERENCE varchar(1000),WARNINGCODE1 varchar(1000),WARNINGCODE2 varchar(1000),WARNINGCODE3 varchar(1000),WARNINGCODE4 varchar(1000),WARNINGCODE5 varchar(1000),WARNINGCODE6 varchar(1000),WARNINGCODE7 varchar(1000),WARNINGCODE8 varchar(1000),WARNINGCODE9 varchar(1000),WARNINGCODE10 varchar(1000),WARNINGCODE11 varchar(1000),WARNINGCODE12 varchar(1000),WARNINGCODE13 varchar(1000),WARNINGCODE14 varchar(1000),WARNINGCODE15 varchar(1000),WARNINGCODE16 varchar(1000),WARNINGCODE17 varchar(1000),WARNINGCODE18 varchar(1000),WARNINGCODE19 varchar(1000),WARNINGCODE20 varchar(1000),SERVICE1 varchar(1000),SERVICE2 varchar(1000),SERVICE3 varchar(1000),SERVICE4 varchar(1000),SERVICE5 varchar(1000),SERVICE6 varchar(1000),SERVICE7 varchar(1000),SERVICE8 varchar(1000),LOANCODE varchar(1000),COLLATERALCODE varchar(1000),COLLATERALDATE varchar(1000),APPROVALCODE varchar(1000),APPROVALDATE varchar(1000),PURPOSECODE varchar(1000),ECOACODE varchar(1000),CREDITREPORTINGCODE varchar(1000),PAYMENTTYPE varchar(1000),PAYMENTMETHOD varchar(1000),COUPONCODE varchar(1000),PAYMENTFREQUENCY varchar(1000),PAYMENTSKIPS varchar(1000),PAYMENTCALCTYPE varchar(1000),PARTIALPAYMENT varchar(1000),PAYMENT varchar(1000),LASTPAYMENTDATE varchar(1000),PAYMENTCOUNT varchar(1000),PAYMENTHISTORY1 varchar(1000),PAYMENTHISTORY2 varchar(1000),PAYMENTHISTORY3 varchar(1000),PAYMENTHISTORY4 varchar(1000),PAYMENTHISTORY5 varchar(1000),PAYMENTHISTORY6 varchar(1000),NEWLOANDUEDATECODE varchar(1000),DUEDATEADVANCECODE varchar(1000),DUEDAY1 varchar(1000),DUEDAY2 varchar(1000),DUEDATE varchar(1000),BALLOONDATE varchar(1000),REFUNDPOSTCODE varchar(1000),REFUNDYTD varchar(1000),REFUNDLASTYEAR varchar(1000),INTERESTYTD varchar(1000),INTERESTLASTYEAR varchar(1000),INTERESTFROMOPEN varchar(1000),INTERESTTYPE varchar(1000),INTERESTRATE varchar(1000),SPLITRATE varchar(1000),SPLITRATEBALANCE varchar(1000),INTERESTDATE varchar(1000),INTERESTUNPAID varchar(1000),DQNOTICENUMBER varchar(1000),DQNOTICEDATE varchar(1000),DQCARDDATE varchar(1000),LATECHARGETYPE varchar(1000),LATECHARGEACCRUED varchar(1000),LATECHARGEUNPAID varchar(1000),LATECHARGEYTD varchar(1000),LATECHARGELASTYEAR varchar(1000),BALANCE varchar(1000),ORIGINALBALANCE varchar(1000),CREDITLIMIT varchar(1000),PRINCIPALYTD varchar(1000),PRINCIPALLASTYEAR varchar(1000),CHARGEOFFTYPE varchar(1000),CHARGEOFFAMOUNT varchar(1000),SECUREDCODE varchar(1000),SECUREDAMOUNT varchar(1000),INSURANCETYPE varchar(1000),INSURANCEMAX varchar(1000),INSURANCEBALANCE varchar(1000),AVAILCREDITCALC varchar(1000),LASTPURGEDATE varchar(1000),STATEMENTGROUP varchar(1000),STATEMENTDATE varchar(1000),STATEMENTMAILCODE varchar(1000),REGECOUNT varchar(1000),DESCRIPTION varchar(1000),STATEMENTPREVDATE varchar(1000),PAYMENTSKIPSTARTDAY varchar(1000),CREDLIMITEXPIRATION varchar(1000),INTERESTRATEINDEX varchar(1000),INTERESTRATEMARGIN varchar(1000),INTERESTRATEMAX varchar(1000),INTERESTRATEMIN varchar(1000),CREDITREPORTNUMBER varchar(1000),WARNINGEXPIRATION1 varchar(1000),WARNINGEXPIRATION2 varchar(1000),WARNINGEXPIRATION3 varchar(1000),WARNINGEXPIRATION4 varchar(1000),WARNINGEXPIRATION5 varchar(1000),WARNINGEXPIRATION6 varchar(1000),WARNINGEXPIRATION7 varchar(1000),WARNINGEXPIRATION8 varchar(1000),WARNINGEXPIRATION9 varchar(1000),WARNINGEXPIRATION10 varchar(1000),WARNINGEXPIRATION11 varchar(1000),WARNINGEXPIRATION12 varchar(1000),WARNINGEXPIRATION13 varchar(1000),WARNINGEXPIRATION14 varchar(1000),WARNINGEXPIRATION15 varchar(1000),WARNINGEXPIRATION16 varchar(1000),WARNINGEXPIRATION17 varchar(1000),WARNINGEXPIRATION18 varchar(1000),WARNINGEXPIRATION19 varchar(1000),WARNINGEXPIRATION20 varchar(1000),NSFMONTHTODATE varchar(1000),NSFYTD varchar(1000),NSFLASTYEAR varchar(1000),DQCALCULATIONMETHOD varchar(1000),PMTBUCKETAMOUNT1 varchar(1000),PMTBUCKETAMOUNT2 varchar(1000),PMTBUCKETAMOUNT3 varchar(1000),PMTBUCKETAMOUNT4 varchar(1000),PMTBUCKETAMOUNT5 varchar(1000),PMTBUCKETAMOUNT6 varchar(1000),PMTBUCKETAMOUNT7 varchar(1000),PMTBUCKETAMOUNT8 varchar(1000),PMTBUCKETDUEDATE1 varchar(1000),PMTBUCKETDUEDATE2 varchar(1000),PMTBUCKETDUEDATE3 varchar(1000),PMTBUCKETDUEDATE4 varchar(1000),PMTBUCKETDUEDATE5 varchar(1000),PMTBUCKETDUEDATE6 varchar(1000),PMTBUCKETDUEDATE7 varchar(1000),PMTBUCKETDUEDATE8 varchar(1000),PURCHOLDBALANCE1 varchar(1000),PURCHOLDBALANCE2 varchar(1000),PURCHOLDBALANCE3 varchar(1000),PURCHOLDBALANCE4 varchar(1000),PURCHOLDBALANCE5 varchar(1000),PURCHOLDBALANCE6 varchar(1000),PURCHOLDBALANCE7 varchar(1000),PURCHOLDBALANCE8 varchar(1000),PURCHOLDBALANCE9 varchar(1000),PUOLDINTUNPAID varchar(1000),PUINTCHARGE varchar(1000),PURCHNEWBALANCE1 varchar(1000),PURCHNEWBALANCE2 varchar(1000),PURCHNEWBALANCE3 varchar(1000),PURCHNEWBALANCE4 varchar(1000),PURCHNEWBALANCE5 varchar(1000),PURCHNEWBALANCE6 varchar(1000),PURCHNEWBALANCE7 varchar(1000),PURCHNEWBALANCE8 varchar(1000),PURCHNEWBALANCE9 varchar(1000),PUNEWINTUNPAID varchar(1000),CASHADVOLDBALANCE1 varchar(1000),CASHADVOLDBALANCE2 varchar(1000),CASHADVOLDBALANCE3 varchar(1000),CASHADVOLDBALANCE4 varchar(1000),CASHADVOLDBALANCE5 varchar(1000),CASHADVOLDBALANCE6 varchar(1000),CASHADVOLDBALANCE7 varchar(1000),CASHADVOLDBALANCE8 varchar(1000),CASHADVOLDBALANCE9 varchar(1000),CAOLDINTUNPAID varchar(1000),CAINTCHARGE varchar(1000),CATRANSINTCHARGE varchar(1000),CASHADVNEWBALANCE1 varchar(1000),CASHADVNEWBALANCE2 varchar(1000),CASHADVNEWBALANCE3 varchar(1000),CASHADVNEWBALANCE4 varchar(1000),CASHADVNEWBALANCE5 varchar(1000),CASHADVNEWBALANCE6 varchar(1000),CASHADVNEWBALANCE7 varchar(1000),CASHADVNEWBALANCE8 varchar(1000),CASHADVNEWBALANCE9 varchar(1000),CANEWINTUNPAID varchar(1000),FEEOLDBALANCE varchar(1000),FEENEWBALANCE varchar(1000),PURCHAVGBALANCE1 varchar(1000),PURCHAVGBALANCE2 varchar(1000),PURCHAVGBALANCE3 varchar(1000),PURCHAVGBALANCE4 varchar(1000),PURCHAVGBALANCE5 varchar(1000),PURCHAVGBALANCE6 varchar(1000),PURCHAVGBALANCE7 varchar(1000),PURCHAVGBALANCE8 varchar(1000),PURCHAVGBALANCE9 varchar(1000),CASHADVAVGBALANCE1 varchar(1000),CASHADVAVGBALANCE2 varchar(1000),CASHADVAVGBALANCE3 varchar(1000),CASHADVAVGBALANCE4 varchar(1000),CASHADVAVGBALANCE5 varchar(1000),CASHADVAVGBALANCE6 varchar(1000),CASHADVAVGBALANCE7 varchar(1000),CASHADVAVGBALANCE8 varchar(1000),CASHADVAVGBALANCE9 varchar(1000),EFFECTIVEAPR varchar(1000),ORIGINALRATE varchar(1000),UNAMORTIZEDFEES varchar(1000),MATURITYDATE varchar(1000),POINTSYTD varchar(1000),POINTSLASTYEAR varchar(1000),FEECOUNT1 varchar(1000),FEECOUNT2 varchar(1000),FEECOUNT3 varchar(1000),FEECOUNT4 varchar(1000),ESCROWAMOUNT varchar(1000),ESCROWID varchar(1000),LATECHARGEDATE varchar(1000),CUTOTALSUSECODE varchar(1000),PERIODICCAP varchar(1000),PERIODICSTARTRATE varchar(1000),PERIODICSTARTDATE varchar(1000),SINGLEPREMIUMLIFE varchar(1000),SINGLEPREMIUMDISABILITY varchar(1000),FASB91ALTERNATETERM varchar(1000),ORIGUNAMORTIZEDFEES varchar(1000),CREDITREPORTTRANSFERINDICATOR varchar(1000),CREDITREPORTTRANSFERDATE varchar(1000),CREDITREPORTTRANSFERNAME varchar(1000),FEESCHARGESPOSTINGOPTION varchar(1000),MINBALANCE varchar(1000),MINADVANCE varchar(1000),BALLOONAMOUNT varchar(1000),INTERESTRATEMARGINSIGN varchar(1000),BRANCH varchar(1000),CREDITREPORTOCCURDATE varchar(1000),CREDITREPORTLASTSTATUS varchar(1000),CREDITREPORTCOMMENT varchar(1000),FASB91CODE varchar(1000),STUDENTLOANCODE varchar(1000),STUDENTCOVEREDPERIODEND varchar(1000),RISKRATE varchar(1000),DISCOUNTRATE varchar(1000),APR varchar(1000),PREPAIDFINANCECHG varchar(1000),CREDITLIMITGROUP varchar(1000),ALTERNATEPAYMENT varchar(1000),ALTPMTEFFECTIVE varchar(1000),ALTPMTEXPIRATION varchar(1000),INTUNPAIDBILLED varchar(1000),PROMOTYPE1 varchar(1000),PROMOTYPE2 varchar(1000),PROMOEFFECTDATE1 varchar(1000),PROMOEFFECTDATE2 varchar(1000),PROMOEXPIREDATE1 varchar(1000),PROMOEXPIREDATE2 varchar(1000),PROMORATETYPE1 varchar(1000),PROMORATETYPE2 varchar(1000),PROMORATE1 varchar(1000),PROMORATE2 varchar(1000),PROMORATEOFFSET1 varchar(1000),PROMORATEOFFSET2 varchar(1000),PROMORATEMIN1 varchar(1000),PROMORATEMIN2 varchar(1000),PROMORATEMAX1 varchar(1000),PROMORATEMAX2 varchar(1000),PROMOTOTALADVANCES1 varchar(1000),PROMOTOTALADVANCES2 varchar(1000),PROMOADVANCECUTOFF1 varchar(1000),PROMOADVANCECUTOFF2 varchar(1000),PROMOBALANCE1 varchar(1000),PROMOBALANCE2 varchar(1000),APPLICATIONID varchar(1000),CREDITREPORTCONSUMERINFO varchar(1000),CREDITREPORTCOMPLIANCE varchar(1000),LESSEESTATE varchar(1000),LESSEECOUNTY varchar(1000),LESSEECITY varchar(1000),DEALERSTATE varchar(1000),DEALERCOUNTY varchar(1000),DEALERCITY varchar(1000),SALESTAXSTATEINDICATOR varchar(1000),SALESTAXCOUNTYINDICATOR varchar(1000),SALESTAXCITYINDICATOR varchar(1000),LEASETERMINATEDATE varchar(1000),LEASETERMINATEFEE varchar(1000),DEALERRESERVE varchar(1000),DEALERCODE varchar(1000),ACTIVITYDATE varchar(1000),FEEBILLINGDATE varchar(1000),FEEBILLINGAMOUNT varchar(1000),BILLEDFEEUNPAID varchar(1000),BILLEDFEEYTD varchar(1000),BILLEDFEELASTYEAR varchar(1000),BILLEDFEEBUCKETAMOUNT1 varchar(1000),BILLEDFEEBUCKETAMOUNT2 varchar(1000),BILLEDFEEBUCKETAMOUNT3 varchar(1000),BILLEDFEEBUCKETAMOUNT4 varchar(1000),BILLEDFEEBUCKETAMOUNT5 varchar(1000),BILLEDFEEBUCKETAMOUNT6 varchar(1000),BILLEDFEEBUCKETAMOUNT7 varchar(1000),BILLEDFEEBUCKETAMOUNT8 varchar(1000),CCPROMOEFFECTDATE2 varchar(1000),CCPROMOEFFECTDATE3 varchar(1000),CCPROMOEFFECTDATE4 varchar(1000),CCPROMOEFFECTDATE5 varchar(1000),CCPROMOEFFECTDATE6 varchar(1000),CCPROMOEFFECTDATE7 varchar(1000),CCPROMOEFFECTDATE8 varchar(1000),CCPROMOEFFECTDATE9 varchar(1000),LATECHGWAIVEDYTD varchar(1000),LATECHGWAIVEDLASTYEAR varchar(1000),LATECHGWAIVEDFROMOPEN varchar(1000),GLACCRUALSTATUSOPTION varchar(1000),CREDITSCORE varchar(1000),CREDITSCORETYPE varchar(1000),LASTADVANCEDATE varchar(1000),ADVANCEAMOUNT varchar(1000),FIRSTPAYMENTDATE varchar(1000),SCHDRATECHANGEDATE varchar(1000),SCHDRATE varchar(1000),SCHDSPLITBALANCE varchar(1000),SCHDSPLITRATE varchar(1000),SCHDPERIODSTARTRATE varchar(1000),SCHDPERIODSTARTDATE varchar(1000),PERIODICFREQUENCY varchar(1000),AMORTIZATIONSCHD varchar(1000),AMORTIZATIONSCHDTYPE varchar(1000),CALLITEMSCHD varchar(1000),CALLITEMSCHDTYPE varchar(1000),MEMBERUSERTRANSFERCODE varchar(1000),CORPORATEUSERTRANSFERCODE varchar(1000),PARTICIPATIONNUMBER varchar(1000),VIN varchar(1000),USERCHAR1 varchar(1000),USERCHAR2 varchar(1000),USERCHAR3 varchar(1000),USERCHAR4 varchar(1000),USERAMOUNT1 varchar(1000),USERAMOUNT2 varchar(1000),USERDATE1 varchar(1000),USERDATE2 varchar(1000),BUREAUSCORE1 varchar(1000),BUREAUSCORE2 varchar(1000),BUREAUSCORE3 varchar(1000),BUREAUSCORE4 varchar(1000),STUDENTLOANORIGFEEYTD varchar(1000),STUDENTLOANORIGFEELASTYEAR varchar(1000),STUDENTLOANCAPINTYTD varchar(1000),STUDENTLOANCAPINTLASTYEAR varchar(1000),PUTITEMSCHD varchar(1000),PUTITEMSCHDTYPE varchar(1000),LEDGERACCRUAL varchar(1000),LEDGERACCRUALDATE varchar(1000),CURRINTPAYABLE varchar(1000),MTDACCRUEDINT varchar(1000),MTDPAIDINT varchar(1000),MTDACCUMULATEDINT varchar(1000),PREMTHINTACCUMLTD1 varchar(1000),PREMTHINTACCUMLTD2 varchar(1000),PREMTHINTACCUMLTD3 varchar(1000),PREMTHINTACCUMLTD4 varchar(1000),PREMTHINTACCUMLTD5 varchar(1000),PREMTHINTACCUMLTD6 varchar(1000),PREMTHINTACCUMLTD7 varchar(1000),PREMTHINTACCUMLTD8 varchar(1000),PREMTHINTACCUMLTD9 varchar(1000),PREMTHINTACCUMLTD10 varchar(1000),PREMTHINTACCUMLTD11 varchar(1000),PREMTHINTACCUMLTD12 varchar(1000),PREMTHINTACCRUED1 varchar(1000),PREMTHINTACCRUED2 varchar(1000),PREMTHINTACCRUED3 varchar(1000),PREMTHINTPAID1 varchar(1000),PREMTHINTPAID2 varchar(1000),PREMTHINTPAID3 varchar(1000),LASTACCRUPDATEDATE varchar(1000),MTDPRIORRATEACCRUAL varchar(1000),MICRACCTNUMBER varchar(1000),CURRMONTHPAIDINT varchar(1000),INDIRECTDEALERNUM varchar(1000),INDIRECTPLANID varchar(1000),CRPMTCURRENT varchar(1000),CRPMTHISTORY1 varchar(1000),CRPMTHISTORY2 varchar(1000),CRPMTHISTORY3 varchar(1000),CRPMTHISTORY4 varchar(1000),CRPMTHISTORY5 varchar(1000),CRPMTHISTORY6 varchar(1000),CRPMTHISTORY7 varchar(1000),CRPMTHISTORY8 varchar(1000),CRPMTHISTORY9 varchar(1000),CRPMTHISTORY10 varchar(1000),CRPMTHISTORY11 varchar(1000),CRPMTHISTORY12 varchar(1000),CRPMTHISTORY13 varchar(1000),CRPMTHISTORY14 varchar(1000),CRPMTHISTORY15 varchar(1000),CRPMTHISTORY16 varchar(1000),CRPMTHISTORY17 varchar(1000),CRPMTHISTORY18 varchar(1000),CRPMTHISTORY19 varchar(1000),CRPMTHISTORY20 varchar(1000),CRPMTHISTORY21 varchar(1000),CRPMTHISTORY22 varchar(1000),CRPMTHISTORY23 varchar(1000),CRPMTHISTORY24 varchar(1000),CRHIGHBAL varchar(1000),LASTCRREPORTDATE varchar(1000),REFINANCEBALANCE varchar(1000),REFINANCEDATE varchar(1000),REFINANCECOUNTER varchar(1000),PAYMENTAPPLICATIONMETHOD varchar(1000),SBAGPNUMBER varchar(1000),INTPAIDTODATE varchar(1000),INTPAIDPARTIALDAYAMT varchar(1000),CREDITREPORTCONSUMERINFODATE varchar(1000),CURRSTMTFEES varchar(1000),PREVSTMTFEES varchar(1000),CURRSTMTINTACCRD varchar(1000),PREVSTMTINTACCRD varchar(1000),NICKNAME varchar(1000),FIRSTINSBIRTHDATE varchar(1000),SECONDINSBIRTHDATE varchar(1000),ORIGINSURANCETYPE varchar(1000),PMIYTD varchar(1000),PMILASTYEAR varchar(1000),RECORDCHANGEDATE varchar(1000),PMIORIGINALVALUE varchar(1000),PMIPURCHASEPRICE varchar(1000),PMIAPPRAISEDVALUE varchar(1000),HIGHRISKCODE varchar(1000),DQNOTICETYPE varchar(1000),COMBOSEG0PMTORDER varchar(1000),COMBOPMTORDERMETH varchar(1000),COMBOLNSEGMENTMAX varchar(1000),SEG0DESCRIPTION varchar(1000),SEG0PAYMENTORDER varchar(1000),SEG0LEVELPRINPMT varchar(1000),CAPPEDFEESAMTPERIOD varchar(1000),CAPPEDFEESAMOUNTCAP varchar(1000),CAPPEDFEESCNTPERIOD varchar(1000),CAPPEDFEESCOUNTCAP varchar(1000),MORTGINSCOLLYTD varchar(1000),MORTGINSCOLLLASTYR varchar(1000),CREDITRPTDEFERREDPMTSTART varchar(1000),BTOLDINTUNPAID varchar(1000),BTINTCHARGE varchar(1000),BTTRANSINTCHARGE varchar(1000),BALXFRNEWBALANCE1 varchar(1000),BALXFRNEWBALANCE2 varchar(1000),BALXFRNEWBALANCE3 varchar(1000),BALXFRNEWBALANCE4 varchar(1000),BALXFRNEWBALANCE5 varchar(1000),BALXFRNEWBALANCE6 varchar(1000),BALXFRNEWBALANCE7 varchar(1000),BALXFRNEWBALANCE8 varchar(1000),BALXFRNEWBALANCE9 varchar(1000),BTNEWINTUNPAID varchar(1000),BALXFRAVGBALANCE1 varchar(1000),BALXFRAVGBALANCE2 varchar(1000),BALXFRAVGBALANCE3 varchar(1000),BALXFRAVGBALANCE4 varchar(1000),BALXFRAVGBALANCE5 varchar(1000),BALXFRAVGBALANCE6 varchar(1000),BALXFRAVGBALANCE7 varchar(1000),BALXFRAVGBALANCE8 varchar(1000),BALXFRAVGBALANCE9 varchar(1000),BALXFROLDBALANCE1 varchar(1000),BALXFROLDBALANCE2 varchar(1000),BALXFROLDBALANCE3 varchar(1000),BALXFROLDBALANCE4 varchar(1000),BALXFROLDBALANCE5 varchar(1000),BALXFROLDBALANCE6 varchar(1000),BALXFROLDBALANCE7 varchar(1000),BALXFROLDBALANCE8 varchar(1000),BALXFROLDBALANCE9 varchar(1000),CREATEDBYUSER varchar(1000),CREATEDATBRANCH varchar(1000),ORIGRISKGRADE varchar(1000),ESCROWUNPAID varchar(1000),STMTLATECHGUNPAID varchar(1000),STMTESCROWUNPAID varchar(1000),CRINTTYPEIND varchar(1000),FEESYTD varchar(1000),FEESLASTYEAR varchar(1000),STMTFEESYTD varchar(1000),INSURANCEYTD varchar(1000),INSURANCELASTYEAR varchar(1000),CABTTRANSINTCHARGEBILLEDYTD varchar(1000),CCINTBILLEDYTD varchar(1000),CCINTBILLEDLASTYEAR varchar(1000),STMTCCINTBILLEDYTD varchar(1000),STMTMAXLATEFEE varchar(1000),VARIABLERATEINDICATOR varchar(1000),LASTACCRUALREVERSAL varchar(1000),MFOELID varchar(1000),LATECHGPDFROMOPEN varchar(1000),STMTLTCHGPDFRMOPN varchar(1000),STMTINTFROMOPEN varchar(1000),PRINPAIDFROMOPEN varchar(1000),STMTPRINPDFROMOPEN varchar(1000),ESCROWAPPLIED varchar(1000),ESCROWBUCKETAMOUNT1 varchar(1000),ESCROWBUCKETAMOUNT2 varchar(1000),ESCROWBUCKETAMOUNT3 varchar(1000),ESCROWBUCKETAMOUNT4 varchar(1000),ESCROWBUCKETAMOUNT5 varchar(1000),ESCROWBUCKETAMOUNT6 varchar(1000),ESCROWBUCKETAMOUNT7 varchar(1000),ESCROWBUCKETAMOUNT8 varchar(1000),UNAPPLIEDPARTIALPMT varchar(1000),ALLOWUNAPPLIEDPMT varchar(1000),STMTUNAPPLIEDPARTIALPMT varchar(1000),STMTMAXPENALTYAPR varchar(1000),OVLOPTIN varchar(1000),OVLAUTHFEE varchar(1000),OVLAUTHFEEEFFDATE varchar(1000),OVLPREVAUTHFEE varchar(1000),OVLCYCLECOUNT1 varchar(1000),OVLCYCLECOUNT2 varchar(1000),OVLCYCLECOUNT3 varchar(1000),OVLSTMTDISCLFEE varchar(1000),CARDACTOVERLIMITFEEEVENTDATE varchar(1000),CARDACTLATEFEEEVENTDATE varchar(1000),CARDACTDECLCHKAXSFEEEVENTDATE varchar(1000),CARDACTRETURNITEMFEEEVENTDATE varchar(1000),NEWSEGCUTOFFOPTION varchar(1000),NEWSEGCUTOFFDAYS varchar(1000),STMTPRINCIPALYTD varchar(1000),STMTPRINCIPALLASTYEAR varchar(1000),STMTLATECHARGEYTD varchar(1000),STMTLATECHARGELASTYEAR varchar(1000),CAPERCENT varchar(1000),CALIMITMAX varchar(1000),BTPERCENT varchar(1000),BTLIMITMAX varchar(1000),COMBINEDCABTPERCENT varchar(1000),COMBINEDCABTLIMITMAX varchar(1000),FEEADDONSINCELASTSTMT varchar(1000),PUADDONSINCELASTSTMT1 varchar(1000),PUADDONSINCELASTSTMT2 varchar(1000),PUADDONSINCELASTSTMT3 varchar(1000),PUADDONSINCELASTSTMT4 varchar(1000),PUADDONSINCELASTSTMT5 varchar(1000),PUADDONSINCELASTSTMT6 varchar(1000),PUADDONSINCELASTSTMT7 varchar(1000),PUADDONSINCELASTSTMT8 varchar(1000),PUADDONSINCELASTSTMT9 varchar(1000),CAADDONSINCELASTSTMT1 varchar(1000),CAADDONSINCELASTSTMT2 varchar(1000),CAADDONSINCELASTSTMT3 varchar(1000),CAADDONSINCELASTSTMT4 varchar(1000),CAADDONSINCELASTSTMT5 varchar(1000),CAADDONSINCELASTSTMT6 varchar(1000),CAADDONSINCELASTSTMT7 varchar(1000),CAADDONSINCELASTSTMT8 varchar(1000),CAADDONSINCELASTSTMT9 varchar(1000),BTADDONSINCELASTSTMT1 varchar(1000),BTADDONSINCELASTSTMT2 varchar(1000),BTADDONSINCELASTSTMT3 varchar(1000),BTADDONSINCELASTSTMT4 varchar(1000),BTADDONSINCELASTSTMT5 varchar(1000),BTADDONSINCELASTSTMT6 varchar(1000),BTADDONSINCELASTSTMT7 varchar(1000),BTADDONSINCELASTSTMT8 varchar(1000),BTADDONSINCELASTSTMT9 varchar(1000),FEEPMTSINCELASTSTMT varchar(1000),PUPMTSINCELASTSTMT1 varchar(1000),PUPMTSINCELASTSTMT2 varchar(1000),PUPMTSINCELASTSTMT3 varchar(1000),PUPMTSINCELASTSTMT4 varchar(1000),PUPMTSINCELASTSTMT5 varchar(1000),PUPMTSINCELASTSTMT6 varchar(1000),PUPMTSINCELASTSTMT7 varchar(1000),PUPMTSINCELASTSTMT8 varchar(1000),PUPMTSINCELASTSTMT9 varchar(1000),CAPMTSINCELASTSTMT1 varchar(1000),CAPMTSINCELASTSTMT2 varchar(1000),CAPMTSINCELASTSTMT3 varchar(1000),CAPMTSINCELASTSTMT4 varchar(1000),CAPMTSINCELASTSTMT5 varchar(1000),CAPMTSINCELASTSTMT6 varchar(1000),CAPMTSINCELASTSTMT7 varchar(1000),CAPMTSINCELASTSTMT8 varchar(1000),CAPMTSINCELASTSTMT9 varchar(1000),BTPMTSINCELASTSTMT1 varchar(1000),BTPMTSINCELASTSTMT2 varchar(1000),BTPMTSINCELASTSTMT3 varchar(1000),BTPMTSINCELASTSTMT4 varchar(1000),BTPMTSINCELASTSTMT5 varchar(1000),BTPMTSINCELASTSTMT6 varchar(1000),BTPMTSINCELASTSTMT7 varchar(1000),BTPMTSINCELASTSTMT8 varchar(1000),BTPMTSINCELASTSTMT9 varchar(1000),MAXDUEDATEADVANCEPERIOD varchar(1000),SEG0BEGINNINGCYCLEDATE varchar(1000),INITIALBCDSETTINGOPTION varchar(1000),BCDDAY1 varchar(1000),BCDDAY2 varchar(1000),INTPAYOFFCALC varchar(1000),STMTFEESLASTYEAR varchar(1000),INSURANCEYTDNOADJ varchar(1000),INSURANCELSTYRNOADJ varchar(1000),LATECHGYTDNOADJ varchar(1000),LATECHGLASTYRNOADJ varchar(1000),FEESYTDNOADJ varchar(1000),FEESLASTYRNOADJ varchar(1000),BILLEDFEEYTDNOADJ varchar(1000),BILLEDFEELSTYRNOADJ varchar(1000),PREPAYMENTPENALTY varchar(1000),NEXTRATECHANGEDATE varchar(1000),RATECHANGECYCLEMONTHS varchar(1000),TOTALACCRUALREVERSAL varchar(1000),LASTACCRREVERSALDATE varchar(1000),ACCRREINSTATEMENTDATE varchar(1000),ACCRUALSTATUS varchar(1000),ARMNOTICE varchar(1000),INITIALARMNOTICE varchar(1000),INITARMNOTICECREATIONDATE varchar(1000),LASTARMNOTICECREATIONDATE varchar(1000),OCCUPANCYTYPE varchar(1000),AMORTIZATIONTERM varchar(1000),PREPAYMENTPENALTYEXPDATE varchar(1000),RATEROUNDINGMETHOD varchar(1000),ROUNDRATETO varchar(1000),PROPERTYADDRESSTYPE varchar(1000),PROPERTYJURISDICTION varchar(1000),ASSESSORPARCELNUMBER varchar(1000),BEGINNINGYEARBALANCE varchar(1000),PREVBEGINNINGYEARBALANCE varchar(1000),MILITARYAPRLOAN varchar(1000),SEG0CURRSTMTINTACCRD varchar(1000),SEG0PREVSTMTINTACCRD varchar(1000),AGENCYIDENTIFIER varchar(1000),AGENCYACCTNUMBER varchar(1000),MORTGAGEIDNUMBER varchar(1000),LOSSMITEFFECTDATE varchar(1000),LOSSMITEXPIREDATE varchar(1000),LOSSMITSTMTMSGCODE varchar(1000),FORECLOSUREEFFECTDATE varchar(1000),FORECLOSUREEXPIREDATE varchar(1000),FORECLOSURESTMTMSGCODE varchar(1000),SENDFINALCHGOFFSTMT varchar(1000),FINALCHGOFFSTMTDATE varchar(1000),FINALCHGOFFSTMTMSGCODE varchar(1000),ORIGINATIONBALANCE varchar(1000),EARLYINTERVNTNNOTICEDATE varchar(1000),ACQUISITIONDATE varchar(1000),ACQUISITIONBALANCE varchar(1000),STMTNOTESTARTDATE varchar(1000),MAPRCURRSTMTINTACCRD varchar(1000),LOSSMITPAYMENT varchar(1000),LOSSMITPMTSTMTMSGCODE varchar(1000),REGPAYMENTSTMTMSGCODE varchar(1000),ACCELERATIONGOODTHRUDATE varchar(1000),ACCELERATIONAMT varchar(1000),ACCELERATIONSTMTMSGCODE varchar(1000),REINSTATEMENTGOODTHRUDATE varchar(1000),REINSTATEMENTAMT varchar(1000),REINSTATEMENTSTMTMSGCODE varchar(1000),CURRSTMTLOSSMITAMTDUE varchar(1000),PREVSTMTLOSSMITAMTDUE varchar(1000),MTGNUMPROP varchar(1000),BKCHAPTERREPORTED varchar(1000),HMDAUNIVERSALLOANIDENTIFIER1 varchar(1000),HMDAUNIVERSALLOANIDENTIFIER2 varchar(1000),LEASEDISPOSITIONDATE varchar(1000),LEASEDISPOSITIONFEE varchar(1000),FIXEDLESSEESTATETAXRATE varchar(1000),FIXEDLESSEECOUNTYTAXRATE varchar(1000),FIXEDLESSEECITYTAXRATE varchar(1000),FIXEDDEALERSTATETAXRATE varchar(1000),FIXEDDEALERCOUNTYTAXRATE varchar(1000),FIXEDDEALERCITYTAXRATE varchar(1000),POSITIVEPAYDRAFT varchar(1000), file_name varchar(8000), columnsHash varchar(8000), match_PK varchar(8000), activePartition varchar(1), insertedDttm Timestamp ) USING PARQUET LOCATION 'location'

when I run the code Im getting this error:

TaskCanceledException: The operation was canceled.
--> IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request.
---> SocketException: The I/O operation has been aborted because of either a thread exit or an application request

suscription id: 51947fa9-0bc4-4174-b2d1-46cfeedd3fbf

Answer 1

Hi, @Samara Soucy - MSFT @PRADEEPCHEEKATLA it's been more than a month since I posted this, and the problem persists. Is there any workaround for this? We need to deploy a solution and this is holding us back.

Answer 2

Hi @Samara Soucy - MSFT ,

I tried what you suggested and also creating a new Synapse instance, the result is the same.

I also tried using different sizes of Spark pools, the result is always the same

I tried with another query to create another table and the result is the same:
TaskCanceledException: The operation was canceled.
--> IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request.
---> SocketException: The I/O operation has been aborted because of either a thread exit or an application request

Here is the log, I'm trying to create a table, but the error the spark app is giving me "HiveMetastoreClientImp: Cannot find table raw.savings"

hive-metastore/lib/compress-lzf-1.0.3.jar:file:/opt/hive-metastore/lib/hbase-client-1.3.1.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/hive-jdbc.jar:file:/opt/hive-metastore/lib/geronimo-annotation_1.0_spec-1.1.1.jar:file:/opt/hive-metastore/lib/javax.jdo-3.2.0-m3.jar:file:/opt/hive-metastore/lib/hive-shims-common.jar:file:/opt/hive-metastore/lib/aether-connector-file-0.9.0.M2.jar:file:/opt/hive-metastore/lib/gson-2.2.4.jar:file:/opt/hive-metastore/lib/rhino-1.7R5.jar:file:/opt/hive-metastore/lib/avatica-metrics-1.8.0.jar:file:/opt/hive-metastore/lib/jdo-api-3.0.1.jar:file:/opt/hive-metastore/lib/jackson-jaxrs-smile-provider-2.4.6.jar:file:/opt/hive-metastore/lib/antlr4-runtime-4.5.jar:file:/opt/hive-metastore/lib/lz4-1.3.0.jar:file:/opt/hive-metastore/lib/hive-hcatalog-core.jar:file:/opt/hive-metastore/lib/hive-beeline-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/config-magic-0.9.jar:file:/opt/hive-metastore/lib/hive-service-rpc-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/airline-0.7.jar:file:/opt/hive-metastore/lib/opencsv-2.3.jar:file:/opt/hive-metastore/lib/derbynet-10.11.1.1.jar:file:/opt/hive-metastore/lib/hive-common-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/transaction-api-1.1.jar:file:/opt/hive-metastore/lib/google-http-client-jackson2-1.15.0-rc.jar:file:/opt/hive-metastore/lib/datanucleus-rdbms-4.1.19.jar:file:/opt/hive-metastore/lib/hive-shims.jar:file:/opt/hive-metastore/lib/ST4-4.0.4.jar:file:/opt/hive-metastore/lib/accumulo-start-1.6.0.jar:file:/opt/hive-metastore/lib/metrics-core-2.2.0.jar:file:/opt/hive-metastore/lib/aether-connector-okhttp-0.0.9.jar:file:/opt/hive-metastore/lib/commons-cli-1.2.jar:file:/opt/hive-metastore/lib/hive-druid-handler-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/jetty-6.1.26.jar:file:/opt/hive-metastore/lib/accumulo-fate-1.6.0.jar:file:/opt/hive-metastore/lib/aether-spi-0.9.0.M2.jar:file:/opt/hive-metastore/lib/hive-testutils-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/commons-codec-1.4.jar:file:/opt/hive-metastore/lib/metrics-core-3.1.0.jar:file:/opt/hive-metastore/lib/calcite-druid-1.10.0.jar:file:/opt/hive-metastore/lib/snappy-java-1.0.5.jar:file:/opt/hive-metastore/lib/libfb303-0.9.3.jar:file:/opt/hive-metastore/lib/jetty-util-6.1.26.jar:file:/opt/hive-metastore/lib/htrace-core-3.1.0-incubating.jar:file:/opt/hive-metastore/lib/hbase-hadoop2-compat-1.3.1.2.6.99.201-39240152-tests.jar:file:/opt/hive-metastore/lib/maven-scm-provider-svnexe-1.4.jar:file:/opt/hive-metastore/lib/hive-shims-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/hive-llap-client-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/jcommander-1.32.jar:file:/opt/hive-metastore/lib/ant-launcher-1.9.1.jar:file:/opt/hive-metastore/lib/bytebuffer-collections-0.2.5.jar:file:/opt/hive-metastore/lib/commons-logging-1.2.jar:file:/opt/hive-metastore/lib/commons-math3-3.6.1.jar:file:/opt/hive-metastore/lib/postgresql-9.4.1208.jre7.jar:file:/opt/hive-metastore/lib/servlet-api-2.4.jar:file:/opt/hive-metastore/lib/hive-llap-common-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/hive-exec.jar:file:/opt/hive-metastore/lib/aether-util-0.9.0.M2.jar:file:/opt/hive-metastore/lib/audience-annotations-0.5.0.jar:file:/opt/hive-metastore/lib/metrics-json-3.1.0.jar:file:/opt/hive-metastore/lib/curator-recipes-2.7.1.jar:file:/opt/hive-metastore/lib/jettison-1.1.jar:file:/opt/hive-metastore/lib/commons-math-2.2.jar:file:/opt/hive-metastore/lib/jetty-servlets-9.2.5.v20141112.jar:file:/opt/hive-metastore/lib/hive-hplsql-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/hive-service.jar:file:/opt/hive-metastore/lib/commons-lang3-3.1.jar:file:/opt/hive-metastore/lib/server-metrics-0.2.8.jar:file:/opt/hive-metastore/lib/jetty-client-9.2.5.v20141112.jar:file:/opt/hive-metastore/lib/http-client-1.0.4.jar:file:/opt/hive-metastore/lib/jetty-http-9.2.5.v20141112.jar:file:/opt/hive-metastore/lib/maven-settings-3.1.1.jar:file:/opt/hive-metastore/lib/json4s-jackson_2.11-3.5.3.jar:file:/opt/hive-metastore/lib/jetty-servlet-9.2.5.v20141112.jar:file:/opt/hive-metastore/lib/curator-framework-2.7.1.jar:file:/opt/hive-metastore/lib/hive-llap-ext-client-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/asm-tree-3.1.jar:file:/opt/hive-metastore/lib/guice-multibindings-4.1.0.jar:file:/opt/hive-metastore/lib/TokenLibrary-assembly-1.0.jar:file:/opt/hive-metastore/lib/hive-cli-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/hive-jdbc-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/zookeeper-3.4.11.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/regexp-1.3.jar:file:/opt/hive-metastore/lib/avro-1.7.7.jar:file:/opt/hive-metastore/lib/hive-hbase-handler-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/maven-settings-builder-3.1.1.jar:file:/opt/hive-metastore/lib/slider-core-0.90.2-incubating.jar:file:/opt/hive-metastore/lib/hbase-annotations-1.3.1.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/druid-hdfs-storage-0.9.2.jar:file:/opt/hive-metastore/lib/commons-pool-1.5.4.jar:file:/opt/hive-metastore/lib/jline-2.12.jar:file:/opt/hive-metastore/lib/hive-llap-tez-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/libthrift-0.9.3.jar:file:/opt/hive-metastore/lib/hive-vector-code-gen.jar:file:/opt/hive-metastore/lib/jta-1.1.jar:file:/opt/hive-metastore/lib/hbase-procedure-1.3.1.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/hive-accumulo-handler.jar:file:/opt/hive-metastore/lib/datanucleus-api-jdo-4.2.4.jar:file:/opt/hive-metastore/lib/hive-hcatalog-server-extensions-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/commons-compiler-2.7.6.jar:file:/opt/hive-metastore/lib/microsoft-catalog-metastore-client-1.0.44.jar:file:/opt/hive-metastore/lib/json4s-ast_2.11-3.5.3.jar:file:/opt/hive-metastore/lib/hive-llap-common-2.3.2.2.6.99.201-39240152-tests.jar:file:/opt/hive-metastore/lib/commons-el-1.0.jar:file:/opt/hive-metastore/lib/jasper-runtime-5.5.23.jar:file:/opt/hive-metastore/lib/commons-dbcp2-2.0.1.jar:file:/opt/hive-metastore/lib/tesla-aether-0.0.5.jar:file:/opt/hive-metastore/lib/joni-2.1.2.jar:file:/opt/hive-metastore/lib/super-csv-2.2.0.jar:file:/opt/hive-metastore/lib/guice-servlet-4.1.0.jar:file:/opt/hive-metastore/lib/hive-shims-0.23-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/javax.inject-1.jar:file:/opt/hive-metastore/lib/jersey-client-1.19.jar:file:/opt/hive-metastore/lib/hive-common.jar:file:/opt/hive-metastore/lib/jackson-dataformat-smile-2.4.6.jar:file:/opt/hive-metastore/lib/hbase-hadoop-compat-1.3.1.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/jackson-jaxrs-json-provider-2.4.6.jar:file:/opt/hive-metastore/lib/jackson-databind-2.6.5.jar:file:/opt/hive-metastore/lib/accumulo-core-1.6.0.jar:file:/opt/hive-metastore/lib/asm-commons-3.1.jar:file:/opt/hive-metastore/lib/jackson-jaxrs-1.9.13.jar:file:/opt/hive-metastore/lib/maven-model-3.1.1.jar:file:/opt/hive-metastore/lib/hive-jdbc-handler-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/jetty-continuation-9.2.5.v20141112.jar:file:/opt/hive-metastore/lib/jasper-compiler-5.5.23.jar:file:/opt/hive-metastore/lib/jcodings-1.0.8.jar:file:/opt/hive-metastore/lib/commons-vfs2-2.0.jar:file:/opt/hive-metastore/lib/hive-cli.jar:file:/opt/hive-metastore/lib/hive-llap-server-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/stax-api-1.0.1.jar:file:/opt/hive-metastore/lib/jackson-core-2.6.5.jar:file:/opt/hive-metastore/lib/aether-api-0.9.0.M2.jar:file:/opt/hive-metastore/lib/hive-beeline.jar:file:/opt/hive-metastore/lib/hive-serde.jar:file:/opt/hive-metastore/lib/log4j-slf4j-impl-2.6.2.jar:file:/opt/hive-metastore/lib/janino-2.7.6.jar:file:/opt/hive-metastore/lib/aether-impl-0.9.0.M2.jar:file:/opt/hive-metastore/lib/wagon-provider-api-2.4.jar:file:/opt/hive-metastore/lib/classmate-1.0.0.jar:file:/opt/hive-metastore/lib/metrics-jvm-3.1.0.jar:file:/opt/hive-metastore/lib/javolution-5.5.1.jar:file:/opt/hive-metastore/lib/geronimo-jta_1.1_spec-1.1.1.jar:file:/opt/hive-metastore/lib/jackson-annotations-2.6.0.jar:file:/opt/hive-metastore/lib/irc-api-1.0-0014.jar:file:/opt/hive-metastore/lib/derby-10.10.2.0.jar:file:/opt/hive-metastore/lib/calcite-linq4j-1.10.0.jar:file:/opt/hive-metastore/lib/derbyclient-10.11.1.1.jar:file:/opt/hive-metastore/lib/druid-processing-0.9.2.jar:file:/opt/hive-metastore/lib/accumulo-trace-1.6.0.jar:file:/opt/hive-metastore/lib/jsr305-3.0.0.jar:file:/opt/hive-metastore/lib/velocity-1.5.jar:file:/opt/hive-metastore/lib/jackson-datatype-guava-2.4.6.jar:file:/opt/hive-metastore/lib/activation-1.1.jar:file:/opt/hive-metastore/lib/hbase-hadoop2-compat-1.3.1.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/org.abego.treelayout.core-1.0.1.jar:file:/opt/hive-metastore/lib/javax.mail-1.6.1.jar:file:/opt/hive-metastore/lib/jetty-security-9.2.5.v20141112.jar:file:/opt/hive-metastore/lib/hive-accumulo-handler-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar:file:/opt/hive-metastore/lib/mapdb-1.0.8.jar:file:/opt/hive-metastore/lib/javax.el-3.0.0.jar:file:/opt/hive-metastore/lib/datanucleus-core-4.1.17.jar:file:/opt/hive-metastore/lib/hive-metastore.jar:file:/opt/hive-metastore/lib/oauth2-oidc-sdk-5.64.4.jar:file:/opt/hive-metastore/lib/jackson-datatype-joda-2.4.6.jar:file:/opt/hive-metastore/lib/maven-repository-metadata-3.1.1.jar:file:/opt/hive-metastore/lib/hive-llap-common.jar:file:/opt/hive-metastore/lib/commons-io-2.4.jar:file:/opt/hive-metastore/lib/json4s-scalap_2.11-3.5.3.jar:file:/opt/hive-metastore/lib/json-smart-2.3.jar:file:/opt/hive-metastore/lib/calcite-core-1.10.0.jar:file:/opt/hive-metastore/lib/json-1.8.jar:file:/opt/hive-metastore/lib/hive-service-rpc.jar:file:/opt/hive-metastore/lib/jsp-api-2.1.jar:file:/opt/hive-metastore/lib/druid-console-0.0.2.jar:file:/opt/hive-metastore/lib/log4j-web-2.6.2.jar:file:/opt/hive-metastore/lib/hbase-prefix-tree-1.3.1.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/maxminddb-0.2.0.jar:file:/opt/hive-metastore/lib/hbase-common-1.3.1.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/jpam-1.1.jar:file:/opt/hive-metastore/lib/hive-llap-server.jar:file:/opt/hive-metastore/lib/jersey-server-1.14.jar:file:/opt/hive-metastore/lib/tempus-fugit-1.1.jar:file:/opt/hive-metastore/lib/jersey-core-1.19.jar:file:/opt/hive-metastore/lib/postgresql-metadata-storage-0.9.2.jar:file:/opt/hive-metastore/lib/jetty-io-9.2.5.v20141112.jar:file:/opt/hive-metastore/lib/jackson-xc-1.9.13.jar:file:/opt/hive-metastore/lib/ant-1.6.5.jar:file:/opt/hive-metastore/lib/log4j-jul-2.5.jar
21/06/23 01:42:09 INFO HiveConf: Found configuration file null
21/06/23 01:42:09 INFO SessionTokenBasedTokenProvider: Setting up conf
21/06/23 01:42:09 INFO SessionTokenBasedTokenProvider: SessionTokenBasedTokenProvider initialized
21/06/23 01:42:10 INFO SessionState: Created local directory: /mnt/var/hadoop/tmp/nm-local-dir/usercache/trusted-service-user/appcache/application_1624411145672_0003/container_1624411145672_0003_01_000001/tmp/trusted-service-user
21/06/23 01:42:10 INFO SessionState: Created HDFS directory: wasbs://@81v0q7545n99r09bgnqcz9y4.blob.core.windows.net/tmp/hive/trusted-service-user/bae2191f-b37f-459d-a303-8325ea68469f
21/06/23 01:42:10 INFO SessionState: Created local directory: /mnt/var/hadoop/tmp/nm-local-dir/usercache/trusted-service-user/appcache/application_1624411145672_0003/container_1624411145672_0003_01_000001/tmp/trusted-service-user/bae2191f-b37f-459d-a303-8325ea68469f
21/06/23 01:42:10 INFO SessionState: Created HDFS directory: wasbs://@81v0q7545n99r09bgnqcz9y4.blob.core.windows.net/tmp/hive/trusted-service-user/bae2191f-b37f-459d-a303-8325ea68469f/_tmp_space.db
21/06/23 01:42:10 INFO HiveClientImpl: Warehouse location for Hive client (version 2.3.3) is abfss://@occudlstorage.dfs.core.windows.net/synapse/workspaces/occudatalake/warehouse
21/06/23 01:42:10 INFO SynapseAuthFilter: instance SynapseAuthFilter with hive conf
21/06/23 01:42:10 INFO SynapseAuthFilter: hive proxy https://rpwestus.svc.datafactory.azure.com:44433
21/06/23 01:42:11 WARN DefaultTimer: Can not service-load a timer. Using JavaTimer instead.
21/06/23 01:42:11 INFO HiveMetastoreClientImp: check database exists or not: default
21/06/23 01:42:11 INFO ConvertRequestObjectToJsonFilter: Request body json string :{"HmsRuntimeProperties":{"SparkSessionToken":"eyJhbGciOiJodHRwOi8vd3d3LnczLm9yZy8yMDAxLzA0L3htbGRzaWctbW9yZSNyc2Etc2hhMjU2Iiwia2lkIjoiNkQ5QTU1NzA0MDFGNjAwQ0IyMTFBMjRCN0UzQzQxRUMyRUJCQjBGMiIsInR5cCI6IkpXVCJ9.eyJhdXRoVG9rZW4iOiJBQUVBRkcyYVZYQkFIMkFNc2hHaVMzNDhRZXd1dTdEeUFRQ0ZUdnh3YzEvRUNSeVZNQ3JrakpaRU1DRzlhV2pXWWRKQkJJNXcvZHZHLzllRjJlOWF6TTJEY1F3c0R5K3YwMnpMcTFYaUI1aDNuWWp1b2N5SnpCTDA2aFRTeFA3RndwbzBTd20zTTFMbDRuYlhSVTd3cTJ4dDJCSTBtZkt4aWFMOGhzeFdoY0NZTHprSkVkT3g3emtvZjdkeVdSMEFnQ2FGOGVETlgzVVd4OUd1NGZ4VnlNTFIvUi9PcjVNZ3dDWGsxcU5uZnZDUEdqcmh6MUJuNmpkdjh1aUtWNlNpb3hMUmhXN3dUd2Vuc2RNZ1NrTjRGR2FETjVZUVRRK2xVMW1IdUV3aXZoZi9TQXdTRG1OTXRuVWhJS3ZuUzV1em5iczdxK0krVW5LUis0anFDd0U0cGtzWGJpRHhwR0JmNk5LQTVjUG9iVzBFT1Fpb0RXcDZ0MHczQUJCTjlmVmZzWUJCdFAxQmRIVm5UNXlQQVRBdFAwa0drbUdkd2xuTkJIeTBlWHVybzkwVmIxSk1EVXo1WkhFcm9IV0JxVVBRYXJvQVJjQkxEYWFPdkR0cW1yOXUzczB0TjRWeHNzdjk4blkveUNqdWZiTzBKVS9qeUU2ZFZqS3JnV2JydnBzT2JIZUZQZ3pGNjZPdEZwMjNYbThEQTNaTTgvRE1oZmRBQ1lvcGNQK0xaU3Y2NjRKRnQvWERMK3grcjl2SGxRNFpXZ1ovelE3ODQ0RlFIc3JCL1BWT0ZxNzNSUDVaM2Z6RGpMZkNISHdSYU1QQ1FOUkt6U1NIbE4zK1hDM1dieXluQ1EwUFIyR3pNaEZQZkM4S0UrbTJsVDdpeGlKcFNuOU5Cak5YR3Yvd1VFWVlQMUxRR00wOFJycnd6WERKaURYTGRiL2ZFdnBSbkdZcnFFNTllZzhNeG5IN3VLS0ptTUFGc2NwalZGbHM3NHVNdU9tak9zcDZhVjdkVVYzOXBqTEIwM0V2MVNEdUJJQ0VVWWxMZVk3RUt2czBsNHVIMUJlQzVjbjBVbnlKIiwic2lnbmF0dXJlUGF5bG9hZCI6eyJ1c2VySWQiOiI0NTlmYzNjNi0xYjIxLTQwZWMtYjZjYy05YWU4M2UzY2I5Y2IiLCJqb2JJZCI6IjQiLCJjbHVzdGVySWQiOiJmZDZjNDIzYy00YWVmLTRjZDktOGQzYy00ZWNhYWE5M2I3M2YiLCJ3b3Jrc3BhY2VOYW1lIjoib2NjdWRhdGFsYWtlIiwiY29tcHV0ZU5hbWUiOiJsYXJnUG9vbDEiLCJqb2JUeXBlIjoiU3BhcmtTZXJ2aWNlU2Vzc2lvbiJ9fQ.Sx9OWMqc0Kl3j9J4U7Vsbi0clA82qnFslEsJN8EDLr5XBOqwgqtAP0oU_hiFc5KK1wYQhLlsc1aBn049X2MysWXzUATzKUQ4YptciyiOmmsPufDj6e_uKrwWJi6Eu3caprBMNw3UOyGOQZFuUdUpwatGH74Gfxq5dal5R2-YjqlzTL_JwipA7thdKyylmsJHbo_fQxPTOIUQrvAIzBZzulkWTwrkKB5Wbi6RzYFwdb6KTHyNN6XgloS33BD6nrzycT45EVRAJkQKvq6A2lpZme-sarkALxvqmIRBASWRr8rYl616ClbYggdCE84V3yyC1SVzaIrcCbPFOuVN9vRbzw"}}
21/06/23 01:42:11 INFO SasClient: Response headers : {Server=[Kestrel], X-Content-Type-Options=[nosniff], x-ms-gateway-request-id=[2143fb19-5884-4e0a-b60f-1f83d234e104], Pragma=[no-cache], x-ms-activity-id=[2143fb19-5884-4e0a-b60f-1f83d234e104], x-ms-correlation-request-id=[80b2dc7b-50f8-4f2f-b042-6ca2055e4e9a], Date=[Wed, 23 Jun 2021 01:42:11 GMT], x-ms-response-time-ms=[75], Strict-Transport-Security=[max-age=15724800; includeSubDomains], Cache-Control=[no-cache], Expires=[-1], Content-Length=[320], Content-Type=[application/json; charset=utf-8]}
21/06/23 01:42:11 INFO SasClient: method=GET path=https://tokenservice.westus.azuresynapse.net:443/api/v1/proxy/subscriptions/a392a704-e333-4fbb-8ec6-38d1e02b5b68/resourceGroups/OCCU-RG/providers/Microsoft.Synapse/workspaces/occudatalake/hms/databases/default?api-version=2019-06-01-preview contentType=application/json; charset=UTF-8 accept=application/json status=200
21/06/23 01:42:11 INFO SasClient: Response Str : {"Source":{"Location":"abfss://@occudlstorage.dfs.core.windows.net/synapse/workspaces/occudatalake/warehouse"},"Description":"Default Hive database","Origin":{"Type":"SPARK"},"Name":"default","EntityType":"DATABASE","PublishStatus":"PUBLISHED","ObjectVersion":1,"ObjectId":"0693e1e2-ae3c-4855-ba1e-213c7ada5f76"}
21/06/23 01:42:11 INFO HiveMetastoreClientImp: database default exists
21/06/23 01:42:11 INFO HiveMetastoreClientImp: Start to get database default
21/06/23 01:42:11 INFO ConvertRequestObjectToJsonFilter: Request body json string :{"HmsRuntimeProperties":{"SparkSessionToken":"eyJhbGciOiJodHRwOi8vd3d3LnczLm9yZy8yMDAxLzA0L3htbGRzaWctbW9yZSNyc2Etc2hhMjU2Iiwia2lkIjoiNkQ5QTU1NzA0MDFGNjAwQ0IyMTFBMjRCN0UzQzQxRUMyRUJCQjBGMiIsInR5cCI6IkpXVCJ9.eyJhdXRoVG9rZW4iOiJBQUVBRkcyYVZYQkFIMkFNc2hHaVMzNDhRZXd1dTdEeUFRQ0ZUdnh3YzEvRUNSeVZNQ3JrakpaRU1DRzlhV2pXWWRKQkJJNXcvZHZHLzllRjJlOWF6TTJEY1F3c0R5K3YwMnpMcTFYaUI1aDNuWWp1b2N5SnpCTDA2aFRTeFA3RndwbzBTd20zTTFMbDRuYlhSVTd3cTJ4dDJCSTBtZkt4aWFMOGhzeFdoY0NZTHprSkVkT3g3emtvZjdkeVdSMEFnQ2FGOGVETlgzVVd4OUd1NGZ4VnlNTFIvUi9PcjVNZ3dDWGsxcU5uZnZDUEdqcmh6MUJuNmpkdjh1aUtWNlNpb3hMUmhXN3dUd2Vuc2RNZ1NrTjRGR2FETjVZUVRRK2xVMW1IdUV3aXZoZi9TQXdTRG1OTXRuVWhJS3ZuUzV1em5iczdxK0krVW5LUis0anFDd0U0cGtzWGJpRHhwR0JmNk5LQTVjUG9iVzBFT1Fpb0RXcDZ0MHczQUJCTjlmVmZzWUJCdFAxQmRIVm5UNXlQQVRBdFAwa0drbUdkd2xuTkJIeTBlWHVybzkwVmIxSk1EVXo1WkhFcm9IV0JxVVBRYXJvQVJjQkxEYWFPdkR0cW1yOXUzczB0TjRWeHNzdjk4blkveUNqdWZiTzBKVS9qeUU2ZFZqS3JnV2JydnBzT2JIZUZQZ3pGNjZPdEZwMjNYbThEQTNaTTgvRE1oZmRBQ1lvcGNQK0xaU3Y2NjRKRnQvWERMK3grcjl2SGxRNFpXZ1ovelE3ODQ0RlFIc3JCL1BWT0ZxNzNSUDVaM2Z6RGpMZkNISHdSYU1QQ1FOUkt6U1NIbE4zK1hDM1dieXluQ1EwUFIyR3pNaEZQZkM4S0UrbTJsVDdpeGlKcFNuOU5Cak5YR3Yvd1VFWVlQMUxRR00wOFJycnd6WERKaURYTGRiL2ZFdnBSbkdZcnFFNTllZzhNeG5IN3VLS0ptTUFGc2NwalZGbHM3NHVNdU9tak9zcDZhVjdkVVYzOXBqTEIwM0V2MVNEdUJJQ0VVWWxMZVk3RUt2czBsNHVIMUJlQzVjbjBVbnlKIiwic2lnbmF0dXJlUGF5bG9hZCI6eyJ1c2VySWQiOiI0NTlmYzNjNi0xYjIxLTQwZWMtYjZjYy05YWU4M2UzY2I5Y2IiLCJqb2JJZCI6IjQiLCJjbHVzdGVySWQiOiJmZDZjNDIzYy00YWVmLTRjZDktOGQzYy00ZWNhYWE5M2I3M2YiLCJ3b3Jrc3BhY2VOYW1lIjoib2NjdWRhdGFsYWtlIiwiY29tcHV0ZU5hbWUiOiJsYXJnUG9vbDEiLCJqb2JUeXBlIjoiU3BhcmtTZXJ2aWNlU2Vzc2lvbiJ9fQ.Sx9OWMqc0Kl3j9J4U7Vsbi0clA82qnFslEsJN8EDLr5XBOqwgqtAP0oU_hiFc5KK1wYQhLlsc1aBn049X2MysWXzUATzKUQ4YptciyiOmmsPufDj6e_uKrwWJi6Eu3caprBMNw3UOyGOQZFuUdUpwatGH74Gfxq5dal5R2-YjqlzTL_JwipA7thdKyylmsJHbo_fQxPTOIUQrvAIzBZzulkWTwrkKB5Wbi6RzYFwdb6KTHyNN6XgloS33BD6nrzycT45EVRAJkQKvq6A2lpZme-sarkALxvqmIRBASWRr8rYl616ClbYggdCE84V3yyC1SVzaIrcCbPFOuVN9vRbzw"}}
21/06/23 01:42:11 INFO SasClient: Response headers : {Server=[Kestrel], X-Content-Type-Options=[nosniff], x-ms-gateway-request-id=[ddb1c444-387f-4122-862d-381572e39d44], Pragma=[no-cache], x-ms-activity-id=[ddb1c444-387f-4122-862d-381572e39d44], x-ms-correlation-request-id=[d5a15fc1-4e09-4593-bac6-959695b1aa65], Date=[Wed, 23 Jun 2021 01:42:11 GMT], x-ms-response-time-ms=[35], Strict-Transport-Security=[max-age=15724800; includeSubDomains], Cache-Control=[no-cache], Expires=[-1], Content-Length=[320], Content-Type=[application/json; charset=utf-8]}
21/06/23 01:42:11 INFO SasClient: method=GET path=https://tokenservice.westus.azuresynapse.net:443/api/v1/proxy/subscriptions/a392a704-e333-4fbb-8ec6-38d1e02b5b68/resourceGroups/OCCU-RG/providers/Microsoft.Synapse/workspaces/occudatalake/hms/databases/default?api-version=2019-06-01-preview contentType=application/json; charset=UTF-8 accept=application/json status=200
21/06/23 01:42:11 INFO SasClient: Response Str : {"Source":{"Location":"abfss://@occudlstorage.dfs.core.windows.net/synapse/workspaces/occudatalake/warehouse"},"Description":"Default Hive database","Origin":{"Type":"SPARK"},"Name":"default","EntityType":"DATABASE","PublishStatus":"PUBLISHED","ObjectVersion":1,"ObjectId":"0693e1e2-ae3c-4855-ba1e-213c7ada5f76"}
21/06/23 01:42:11 INFO HiveMetastoreClientImp: get database: {"source":{"provider":null,"location":"abfss://@occudlstorage.dfs.core.windows.net/synapse/workspaces/occudatalake/warehouse","properties":null},"description":"Default Hive database","owner":null,"ownerType":null,"origin":{"type":"SPARK","instanceId":null},"originObjectId":null,"objectId":"0693e1e2-ae3c-4855-ba1e-213c7ada5f76","objectVersion":1,"name":"default","entityType":"DATABASE","publishStatus":"PUBLISHED","properties":null}
21/06/23 01:42:11 INFO HiveMetastoreClientImp: Start to get table raw.savings
21/06/23 01:42:11 INFO ConvertRequestObjectToJsonFilter: Request body json string :{"HmsRuntimeProperties":{"SparkSessionToken":"eyJhbGciOiJodHRwOi8vd3d3LnczLm9yZy8yMDAxLzA0L3htbGRzaWctbW9yZSNyc2Etc2hhMjU2Iiwia2lkIjoiNkQ5QTU1NzA0MDFGNjAwQ0IyMTFBMjRCN0UzQzQxRUMyRUJCQjBGMiIsInR5cCI6IkpXVCJ9.eyJhdXRoVG9rZW4iOiJBQUVBRkcyYVZYQkFIMkFNc2hHaVMzNDhRZXd1dTdEeUFRQ0ZUdnh3YzEvRUNSeVZNQ3JrakpaRU1DRzlhV2pXWWRKQkJJNXcvZHZHLzllRjJlOWF6TTJEY1F3c0R5K3YwMnpMcTFYaUI1aDNuWWp1b2N5SnpCTDA2aFRTeFA3RndwbzBTd20zTTFMbDRuYlhSVTd3cTJ4dDJCSTBtZkt4aWFMOGhzeFdoY0NZTHprSkVkT3g3emtvZjdkeVdSMEFnQ2FGOGVETlgzVVd4OUd1NGZ4VnlNTFIvUi9PcjVNZ3dDWGsxcU5uZnZDUEdqcmh6MUJuNmpkdjh1aUtWNlNpb3hMUmhXN3dUd2Vuc2RNZ1NrTjRGR2FETjVZUVRRK2xVMW1IdUV3aXZoZi9TQXdTRG1OTXRuVWhJS3ZuUzV1em5iczdxK0krVW5LUis0anFDd0U0cGtzWGJpRHhwR0JmNk5LQTVjUG9iVzBFT1Fpb0RXcDZ0MHczQUJCTjlmVmZzWUJCdFAxQmRIVm5UNXlQQVRBdFAwa0drbUdkd2xuTkJIeTBlWHVybzkwVmIxSk1EVXo1WkhFcm9IV0JxVVBRYXJvQVJjQkxEYWFPdkR0cW1yOXUzczB0TjRWeHNzdjk4blkveUNqdWZiTzBKVS9qeUU2ZFZqS3JnV2JydnBzT2JIZUZQZ3pGNjZPdEZwMjNYbThEQTNaTTgvRE1oZmRBQ1lvcGNQK0xaU3Y2NjRKRnQvWERMK3grcjl2SGxRNFpXZ1ovelE3ODQ0RlFIc3JCL1BWT0ZxNzNSUDVaM2Z6RGpMZkNISHdSYU1QQ1FOUkt6U1NIbE4zK1hDM1dieXluQ1EwUFIyR3pNaEZQZkM4S0UrbTJsVDdpeGlKcFNuOU5Cak5YR3Yvd1VFWVlQMUxRR00wOFJycnd6WERKaURYTGRiL2ZFdnBSbkdZcnFFNTllZzhNeG5IN3VLS0ptTUFGc2NwalZGbHM3NHVNdU9tak9zcDZhVjdkVVYzOXBqTEIwM0V2MVNEdUJJQ0VVWWxMZVk3RUt2czBsNHVIMUJlQzVjbjBVbnlKIiwic2lnbmF0dXJlUGF5bG9hZCI6eyJ1c2VySWQiOiI0NTlmYzNjNi0xYjIxLTQwZWMtYjZjYy05YWU4M2UzY2I5Y2IiLCJqb2JJZCI6IjQiLCJjbHVzdGVySWQiOiJmZDZjNDIzYy00YWVmLTRjZDktOGQzYy00ZWNhYWE5M2I3M2YiLCJ3b3Jrc3BhY2VOYW1lIjoib2NjdWRhdGFsYWtlIiwiY29tcHV0ZU5hbWUiOiJsYXJnUG9vbDEiLCJqb2JUeXBlIjoiU3BhcmtTZXJ2aWNlU2Vzc2lvbiJ9fQ.Sx9OWMqc0Kl3j9J4U7Vsbi0clA82qnFslEsJN8EDLr5XBOqwgqtAP0oU_hiFc5KK1wYQhLlsc1aBn049X2MysWXzUATzKUQ4YptciyiOmmsPufDj6e_uKrwWJi6Eu3caprBMNw3UOyGOQZFuUdUpwatGH74Gfxq5dal5R2-YjqlzTL_JwipA7thdKyylmsJHbo_fQxPTOIUQrvAIzBZzulkWTwrkKB5Wbi6RzYFwdb6KTHyNN6XgloS33BD6nrzycT45EVRAJkQKvq6A2lpZme-sarkALxvqmIRBASWRr8rYl616ClbYggdCE84V3yyC1SVzaIrcCbPFOuVN9vRbzw"}}
21/06/23 01:42:11 INFO SasClient: Response headers : {Server=[Kestrel], X-Content-Type-Options=[nosniff], x-ms-gateway-request-id=[7788c5c4-85e5-417a-a488-27615060bcda], Pragma=[no-cache], x-ms-activity-id=[7788c5c4-85e5-417a-a488-27615060bcda], x-ms-correlation-request-id=[cb50b868-c372-41d9-be44-ae4f26485d84], Date=[Wed, 23 Jun 2021 01:42:11 GMT], x-ms-response-time-ms=[59], Strict-Transport-Security=[max-age=15724800; includeSubDomains], Cache-Control=[no-cache], Expires=[-1], Content-Length=[124], Content-Type=[application/json; charset=utf-8]}
21/06/23 01:42:11 INFO SasClient: method=GET path=https://tokenservice.westus.azuresynapse.net:443/api/v1/proxy/subscriptions/a392a704-e333-4fbb-8ec6-38d1e02b5b68/resourceGroups/OCCU-RG/providers/Microsoft.Synapse/workspaces/occudatalake/hms/databases/raw/artifacts/TABLE/savings?api-version=2019-06-01-preview contentType=application/json; charset=UTF-8 accept=application/json status=404
21/06/23 01:42:11 INFO HiveMetastoreClientImp: Cannot find table raw.savings
21/06/23 01:42:11 INFO TokenLibrary: Attempting to fetch access token from cache
21/06/23 01:42:11 WARN InMemoryCacheClient: Token not found in in-memory cache
21/06/23 01:42:11 INFO TokenLibrary: Invoking token service to fetch access token
21/06/23 01:42:11 INFO TokenLibrary: Fetching access token
21/06/23 01:42:12 INFO finagle: Finagle version 19.5.1 (rev=21b8a8b3eeca571eedc7094df53d5eb806856b61) built at 20190520-193515
21/06/23 01:42:12 INFO TokenLibrary: POST success
21/06/23 01:42:13 INFO InMemoryCacheClient: Token successfully cached in memory
21/06/23 01:42:13 INFO InMemoryFileIndex: It took 128 ms to list leaf files for 1 paths.
21/06/23 01:42:13 INFO HiveMetastoreClientImp: Start to get database raw
21/06/23 01:42:13 INFO ConvertRequestObjectToJsonFilter: Request body json string :{"HmsRuntimeProperties":{"SparkSessionToken":"eyJhbGciOiJodHRwOi8vd3d3LnczLm9yZy8yMDAxLzA0L3htbGRzaWctbW9yZSNyc2Etc2hhMjU2Iiwia2lkIjoiNkQ5QTU1NzA0MDFGNjAwQ0IyMTFBMjRCN0UzQzQxRUMyRUJCQjBGMiIsInR5cCI6IkpXVCJ9.eyJhdXRoVG9rZW4iOiJBQUVBRkcyYVZYQkFIMkFNc2hHaVMzNDhRZXd1dTdEeUFRQ0ZUdnh3YzEvRUNSeVZNQ3JrakpaRU1DRzlhV2pXWWRKQkJJNXcvZHZHLzllRjJlOWF6TTJEY1F3c0R5K3YwMnpMcTFYaUI1aDNuWWp1b2N5SnpCTDA2aFRTeFA3RndwbzBTd20zTTFMbDRuYlhSVTd3cTJ4dDJCSTBtZkt4aWFMOGhzeFdoY0NZTHprSkVkT3g3emtvZjdkeVdSMEFnQ2FGOGVETlgzVVd4OUd1NGZ4VnlNTFIvUi9PcjVNZ3dDWGsxcU5uZnZDUEdqcmh6MUJuNmpkdjh1aUtWNlNpb3hMUmhXN3dUd2Vuc2RNZ1NrTjRGR2FETjVZUVRRK2xVMW1IdUV3aXZoZi9TQXdTRG1OTXRuVWhJS3ZuUzV1em5iczdxK0krVW5LUis0anFDd0U0cGtzWGJpRHhwR0JmNk5LQTVjUG9iVzBFT1Fpb0RXcDZ0MHczQUJCTjlmVmZzWUJCdFAxQmRIVm5UNXlQQVRBdFAwa0drbUdkd2xuTkJIeTBlWHVybzkwVmIxSk1EVXo1WkhFcm9IV0JxVVBRYXJvQVJjQkxEYWFPdkR0cW1yOXUzczB0TjRWeHNzdjk4blkveUNqdWZiTzBKVS9qeUU2ZFZqS3JnV2JydnBzT2JIZUZQZ3pGNjZPdEZwMjNYbThEQTNaTTgvRE1oZmRBQ1lvcGNQK0xaU3Y2NjRKRnQvWERMK3grcjl2SGxRNFpXZ1ovelE3ODQ0RlFIc3JCL1BWT0ZxNzNSUDVaM2Z6RGpMZkNISHdSYU1QQ1FOUkt6U1NIbE4zK1hDM1dieXluQ1EwUFIyR3pNaEZQZkM4S0UrbTJsVDdpeGlKcFNuOU5Cak5YR3Yvd1VFWVlQMUxRR00wOFJycnd6WERKaURYTGRiL2ZFdnBSbkdZcnFFNTllZzhNeG5IN3VLS0ptTUFGc2NwalZGbHM3NHVNdU9tak9zcDZhVjdkVVYzOXBqTEIwM0V2MVNEdUJJQ0VVWWxMZVk3RUt2czBsNHVIMUJlQzVjbjBVbnlKIiwic2lnbmF0dXJlUGF5bG9hZCI6eyJ1c2VySWQiOiI0NTlmYzNjNi0xYjIxLTQwZWMtYjZjYy05YWU4M2UzY2I5Y2IiLCJqb2JJZCI6IjQiLCJjbHVzdGVySWQiOiJmZDZjNDIzYy00YWVmLTRjZDktOGQzYy00ZWNhYWE5M2I3M2YiLCJ3b3Jrc3BhY2VOYW1lIjoib2NjdWRhdGFsYWtlIiwiY29tcHV0ZU5hbWUiOiJsYXJnUG9vbDEiLCJqb2JUeXBlIjoiU3BhcmtTZXJ2aWNlU2Vzc2lvbiJ9fQ.Sx9OWMqc0Kl3j9J4U7Vsbi0clA82qnFslEsJN8EDLr5XBOqwgqtAP0oU_hiFc5KK1wYQhLlsc1aBn049X2MysWXzUATzKUQ4YptciyiOmmsPufDj6e_uKrwWJi6Eu3caprBMNw3UOyGOQZFuUdUpwatGH74Gfxq5dal5R2-YjqlzTL_JwipA7thdKyylmsJHbo_fQxPTOIUQrvAIzBZzulkWTwrkKB5Wbi6RzYFwdb6KTHyNN6XgloS33BD6nrzycT45EVRAJkQKvq6A2lpZme-sarkALxvqmIRBASWRr8rYl616ClbYggdCE84V3yyC1SVzaIrcCbPFOuVN9vRbzw"}}
21/06/23 01:42:13 INFO SasClient: Response headers : {Server=[Kestrel], X-Content-Type-Options=[nosniff], x-ms-gateway-request-id=[7d95a04d-0466-4fbf-a8b9-fff8059c07e4], Pragma=[no-cache], x-ms-activity-id=[7d95a04d-0466-4fbf-a8b9-fff8059c07e4], x-ms-correlation-request-id=[2c8a4b7d-c165-4c03-ad89-08e3f6735939], Date=[Wed, 23 Jun 2021 01:42:12 GMT], x-ms-response-time-ms=[38], Strict-Transport-Security=[max-age=15724800; includeSubDomains], Cache-Control=[no-cache], Expires=[-1], Content-Length=[318], Content-Type=[application/json; charset=utf-8]}
21/06/23 01:42:13 INFO SasClient: method=GET path=https://tokenservice.westus.azuresynapse.net:443/api/v1/proxy/subscriptions/a392a704-e333-4fbb-8ec6-38d1e02b5b68/resourceGroups/OCCU-RG/providers/Microsoft.Synapse/workspaces/occudatalake/hms/databases/raw?api-version=2019-06-01-preview contentType=application/json; charset=UTF-8 accept=application/json status=200
21/06/23 01:42:13 INFO SasClient: Response Str : {"Source":{"Location":"abfss://@occudlstorage.dfs.core.windows.net/synapse/workspaces/occudatalake/warehouse/raw.db"},"Description":"","Origin":{"Type":"SPARK"},"Properties":{},"Name":"raw","EntityType":"DATABASE","PublishStatus":"PUBLISHED","ObjectVersion":1,"ObjectId":"6f862a1f-3cfa-4d4a-9bda-4640aab06e33"}
21/06/23 01:42:13 INFO HiveMetastoreClientImp: get database: {"source":{"provider":null,"location":"abfss://@occudlstorage.dfs.core.windows.net/synapse/workspaces/occudatalake/warehouse/raw.db","properties":null},"description":"","owner":null,"ownerType":null,"origin":{"type":"SPARK","instanceId":null},"originObjectId":null,"objectId":"6f862a1f-3cfa-4d4a-9bda-4640aab06e33","objectVersion":1,"name":"raw","entityType":"DATABASE","publishStatus":"PUBLISHED","properties":{}}
21/06/23 01:42:13 INFO HiveMetastoreClientImp: Start to get table raw.savings
21/06/23 01:42:13 INFO ConvertRequestObjectToJsonFilter: Request body json string :{"HmsRuntimeProperties":{"SparkSessionToken":"eyJhbGciOiJodHRwOi8vd3d3LnczLm9yZy8yMDAxLzA0L3htbGRzaWctbW9yZSNyc2Etc2hhMjU2Iiwia2lkIjoiNkQ5QTU1NzA0MDFGNjAwQ0IyMTFBMjRCN0UzQzQxRUMyRUJCQjBGMiIsInR5cCI6IkpXVCJ9.eyJhdXRoVG9rZW4iOiJBQUVBRkcyYVZYQkFIMkFNc2hHaVMzNDhRZXd1dTdEeUFRQ0ZUdnh3YzEvRUNSeVZNQ3JrakpaRU1DRzlhV2pXWWRKQkJJNXcvZHZHLzllRjJlOWF6TTJEY1F3c0R5K3YwMnpMcTFYaUI1aDNuWWp1b2N5SnpCTDA2aFRTeFA3RndwbzBTd20zTTFMbDRuYlhSVTd3cTJ4dDJCSTBtZkt4aWFMOGhzeFdoY0NZTHprSkVkT3g3emtvZjdkeVdSMEFnQ2FGOGVETlgzVVd4OUd1NGZ4VnlNTFIvUi9PcjVNZ3dDWGsxcU5uZnZDUEdqcmh6MUJuNmpkdjh1aUtWNlNpb3hMUmhXN3dUd2Vuc2RNZ1NrTjRGR2FETjVZUVRRK2xVMW1IdUV3aXZoZi9TQXdTRG1OTXRuVWhJS3ZuUzV1em5iczdxK0krVW5LUis0anFDd0U0cGtzWGJpRHhwR0JmNk5LQTVjUG9iVzBFT1Fpb0RXcDZ0MHczQUJCTjlmVmZzWUJCdFAxQmRIVm5UNXlQQVRBdFAwa0drbUdkd2xuTkJIeTBlWHVybzkwVmIxSk1EVXo1WkhFcm9IV0JxVVBRYXJvQVJjQkxEYWFPdkR0cW1yOXUzczB0TjRWeHNzdjk4blkveUNqdWZiTzBKVS9qeUU2ZFZqS3JnV2JydnBzT2JIZUZQZ3pGNjZPdEZwMjNYbThEQTNaTTgvRE1oZmRBQ1lvcGNQK0xaU3Y2NjRKRnQvWERMK3grcjl2SGxRNFpXZ1ovelE3ODQ0RlFIc3JCL1BWT0ZxNzNSUDVaM2Z6RGpMZkNISHdSYU1QQ1FOUkt6U1NIbE4zK1hDM1dieXluQ1EwUFIyR3pNaEZQZkM4S0UrbTJsVDdpeGlKcFNuOU5Cak5YR3Yvd1VFWVlQMUxRR00wOFJycnd6WERKaURYTGRiL2ZFdnBSbkdZcnFFNTllZzhNeG5IN3VLS0ptTUFGc2NwalZGbHM3NHVNdU9tak9zcDZhVjdkVVYzOXBqTEIwM0V2MVNEdUJJQ0VVWWxMZVk3RUt2czBsNHVIMUJlQzVjbjBVbnlKIiwic2lnbmF0dXJlUGF5bG9hZCI6eyJ1c2VySWQiOiI0NTlmYzNjNi0xYjIxLTQwZWMtYjZjYy05YWU4M2UzY2I5Y2IiLCJqb2JJZCI6IjQiLCJjbHVzdGVySWQiOiJmZDZjNDIzYy00YWVmLTRjZDktOGQzYy00ZWNhYWE5M2I3M2YiLCJ3b3Jrc3BhY2VOYW1lIjoib2NjdWRhdGFsYWtlIiwiY29tcHV0ZU5hbWUiOiJsYXJnUG9vbDEiLCJqb2JUeXBlIjoiU3BhcmtTZXJ2aWNlU2Vzc2lvbiJ9fQ.Sx9OWMqc0Kl3j9J4U7Vsbi0clA82qnFslEsJN8EDLr5XBOqwgqtAP0oU_hiFc5KK1wYQhLlsc1aBn049X2MysWXzUATzKUQ4YptciyiOmmsPufDj6e_uKrwWJi6Eu3caprBMNw3UOyGOQZFuUdUpwatGH74Gfxq5dal5R2-YjqlzTL_JwipA7thdKyylmsJHbo_fQxPTOIUQrvAIzBZzulkWTwrkKB5Wbi6RzYFwdb6KTHyNN6XgloS33BD6nrzycT45EVRAJkQKvq6A2lpZme-sarkALxvqmIRBASWRr8rYl616ClbYggdCE84V3yyC1SVzaIrcCbPFOuVN9vRbzw"}}
21/06/23 01:42:13 INFO SasClient: Response headers : {Server=[Kestrel], X-Content-Type-Options=[nosniff], x-ms-gateway-request-id=[928d6b04-44cd-4bcb-a6de-cd0ce86ec445], Pragma=[no-cache], x-ms-activity-id=[928d6b04-44cd-4bcb-a6de-cd0ce86ec445], x-ms-correlation-request-id=[69733c7e-e443-4b29-9c70-c9074021ba4a], Date=[Wed, 23 Jun 2021 01:42:12 GMT], x-ms-response-time-ms=[54], Strict-Transport-Security=[max-age=15724800; includeSubDomains], Cache-Control=[no-cache], Expires=[-1], Content-Length=[124], Content-Type=[application/json; charset=utf-8]}
21/06/23 01:42:13 INFO SasClient: method=GET path=https://tokenservice.westus.azuresynapse.net:443/api/v1/proxy/subscriptions/a392a704-e333-4fbb-8ec6-38d1e02b5b68/resourceGroups/OCCU-RG/providers/Microsoft.Synapse/workspaces/occudatalake/hms/databases/raw/artifacts/TABLE/savings?api-version=2019-06-01-preview contentType=application/json; charset=UTF-8 accept=application/json status=404
21/06/23 01:42:13 INFO HiveMetastoreClientImp: Cannot find table raw.savings
21/06/23 01:42:13 INFO HiveMetastoreClientImp: Start to get database raw
21/06/23 01:42:13 INFO ConvertRequestObjectToJsonFilter: Request body json string :{"HmsRuntimeProperties":{"SparkSessionToken":"eyJhbGciOiJodHRwOi8vd3d3LnczLm9yZy8yMDAxLzA0L3htbGRzaWctbW9yZSNyc2Etc2hhMjU2Iiwia2lkIjoiNkQ5QTU1NzA0MDFGNjAwQ0IyMTFBMjRCN0UzQzQxRUMyRUJCQjBGMiIsInR5cCI6IkpXVCJ9.eyJhdXRoVG9rZW4iOiJBQUVBRkcyYVZYQkFIMkFNc2hHaVMzNDhRZXd1dTdEeUFRQ0ZUdnh3YzEvRUNSeVZNQ3JrakpaRU1DRzlhV2pXWWRKQkJJNXcvZHZHLzllRjJlOWF6TTJEY1F3c0R5K3YwMnpMcTFYaUI1aDNuWWp1b2N5SnpCTDA2aFRTeFA3RndwbzBTd20zTTFMbDRuYlhSVTd3cTJ4dDJCSTBtZkt4aWFMOGhzeFdoY0NZTHprSkVkT3g3emtvZjdkeVdSMEFnQ2FGOGVETlgzVVd4OUd1NGZ4VnlNTFIvUi9PcjVNZ3dDWGsxcU5uZnZDUEdqcmh6MUJuNmpkdjh1aUtWNlNpb3hMUmhXN3dUd2Vuc2RNZ1NrTjRGR2FETjVZUVRRK2xVMW1IdUV3aXZoZi9TQXdTRG1OTXRuVWhJS3ZuUzV1em5iczdxK0krVW5LUis0anFDd0U0cGtzWGJpRHhwR0JmNk5LQTVjUG9iVzBFT1Fpb0RXcDZ0MHczQUJCTjlmVmZzWUJCdFAxQmRIVm5UNXlQQVRBdFAwa0drbUdkd2xuTkJIeTBlWHVybzkwVmIxSk1EVXo1WkhFcm9IV0JxVVBRYXJvQVJjQkxEYWFPdkR0cW1yOXUzczB0TjRWeHNzdjk4blkveUNqdWZiTzBKVS9qeUU2ZFZqS3JnV2JydnBzT2JIZUZQZ3pGNjZPdEZwMjNYbThEQTNaTTgvRE1oZmRBQ1lvcGNQK0xaU3Y2NjRKRnQvWERMK3grcjl2SGxRNFpXZ1ovelE3ODQ0RlFIc3JCL1BWT0ZxNzNSUDVaM2Z6RGpMZkNISHdSYU1QQ1FOUkt6U1NIbE4zK1hDM1dieXluQ1EwUFIyR3pNaEZQZkM4S0UrbTJsVDdpeGlKcFNuOU5Cak5YR3Yvd1VFWVlQMUxRR00wOFJycnd6WERKaURYTGRiL2ZFdnBSbkdZcnFFNTllZzhNeG5I

Answer 3

Hi @Samara Soucy - MSFT ,

I tried what you suggested and also creating a new Synapse instance, the result is the same.

I also tried using different sizes of Spark pools, the result is always the same

I tried with another query to create another table and the result is the same:
TaskCanceledException: The operation was canceled.
--> IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request.
---> SocketException: The I/O operation has been aborted because of either a thread exit or an application request

Here is the log, I'm trying to create a table, but the error the spark app is giving me "HiveMetastoreClientImp: Cannot find table raw.savings"

hive-metastore/lib/compress-lzf-1.0.3.jar:file:/opt/hive-metastore/lib/hbase-client-1.3.1.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/hive-jdbc.jar:file:/opt/hive-metastore/lib/geronimo-annotation_1.0_spec-1.1.1.jar:file:/opt/hive-metastore/lib/javax.jdo-3.2.0-m3.jar:file:/opt/hive-metastore/lib/hive-shims-common.jar:file:/opt/hive-metastore/lib/aether-connector-file-0.9.0.M2.jar:file:/opt/hive-metastore/lib/gson-2.2.4.jar:file:/opt/hive-metastore/lib/rhino-1.7R5.jar:file:/opt/hive-metastore/lib/avatica-metrics-1.8.0.jar:file:/opt/hive-metastore/lib/jdo-api-3.0.1.jar:file:/opt/hive-metastore/lib/jackson-jaxrs-smile-provider-2.4.6.jar:file:/opt/hive-metastore/lib/antlr4-runtime-4.5.jar:file:/opt/hive-metastore/lib/lz4-1.3.0.jar:file:/opt/hive-metastore/lib/hive-hcatalog-core.jar:file:/opt/hive-metastore/lib/hive-beeline-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/config-magic-0.9.jar:file:/opt/hive-metastore/lib/hive-service-rpc-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/airline-0.7.jar:file:/opt/hive-metastore/lib/opencsv-2.3.jar:file:/opt/hive-metastore/lib/derbynet-10.11.1.1.jar:file:/opt/hive-metastore/lib/hive-common-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/transaction-api-1.1.jar:file:/opt/hive-metastore/lib/google-http-client-jackson2-1.15.0-rc.jar:file:/opt/hive-metastore/lib/datanucleus-rdbms-4.1.19.jar:file:/opt/hive-metastore/lib/hive-shims.jar:file:/opt/hive-metastore/lib/ST4-4.0.4.jar:file:/opt/hive-metastore/lib/accumulo-start-1.6.0.jar:file:/opt/hive-metastore/lib/metrics-core-2.2.0.jar:file:/opt/hive-metastore/lib/aether-connector-okhttp-0.0.9.jar:file:/opt/hive-metastore/lib/commons-cli-1.2.jar:file:/opt/hive-metastore/lib/hive-druid-handler-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/jetty-6.1.26.jar:file:/opt/hive-metastore/lib/accumulo-fate-1.6.0.jar:file:/opt/hive-metastore/lib/aether-spi-0.9.0.M2.jar:file:/opt/hive-metastore/lib/hive-testutils-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/commons-codec-1.4.jar:file:/opt/hive-metastore/lib/metrics-core-3.1.0.jar:file:/opt/hive-metastore/lib/calcite-druid-1.10.0.jar:file:/opt/hive-metastore/lib/snappy-java-1.0.5.jar:file:/opt/hive-metastore/lib/libfb303-0.9.3.jar:file:/opt/hive-metastore/lib/jetty-util-6.1.26.jar:file:/opt/hive-metastore/lib/htrace-core-3.1.0-incubating.jar:file:/opt/hive-metastore/lib/hbase-hadoop2-compat-1.3.1.2.6.99.201-39240152-tests.jar:file:/opt/hive-metastore/lib/maven-scm-provider-svnexe-1.4.jar:file:/opt/hive-metastore/lib/hive-shims-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/hive-llap-client-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/jcommander-1.32.jar:file:/opt/hive-metastore/lib/ant-launcher-1.9.1.jar:file:/opt/hive-metastore/lib/bytebuffer-collections-0.2.5.jar:file:/opt/hive-metastore/lib/commons-logging-1.2.jar:file:/opt/hive-metastore/lib/commons-math3-3.6.1.jar:file:/opt/hive-metastore/lib/postgresql-9.4.1208.jre7.jar:file:/opt/hive-metastore/lib/servlet-api-2.4.jar:file:/opt/hive-metastore/lib/hive-llap-common-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/hive-exec.jar:file:/opt/hive-metastore/lib/aether-util-0.9.0.M2.jar:file:/opt/hive-metastore/lib/audience-annotations-0.5.0.jar:file:/opt/hive-metastore/lib/metrics-json-3.1.0.jar:file:/opt/hive-metastore/lib/curator-recipes-2.7.1.jar:file:/opt/hive-metastore/lib/jettison-1.1.jar:file:/opt/hive-metastore/lib/commons-math-2.2.jar:file:/opt/hive-metastore/lib/jetty-servlets-9.2.5.v20141112.jar:file:/opt/hive-metastore/lib/hive-hplsql-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/hive-service.jar:file:/opt/hive-metastore/lib/commons-lang3-3.1.jar:file:/opt/hive-metastore/lib/server-metrics-0.2.8.jar:file:/opt/hive-metastore/lib/jetty-client-9.2.5.v20141112.jar:file:/opt/hive-metastore/lib/http-client-1.0.4.jar:file:/opt/hive-metastore/lib/jetty-http-9.2.5.v20141112.jar:file:/opt/hive-metastore/lib/maven-settings-3.1.1.jar:file:/opt/hive-metastore/lib/json4s-jackson_2.11-3.5.3.jar:file:/opt/hive-metastore/lib/jetty-servlet-9.2.5.v20141112.jar:file:/opt/hive-metastore/lib/curator-framework-2.7.1.jar:file:/opt/hive-metastore/lib/hive-llap-ext-client-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/asm-tree-3.1.jar:file:/opt/hive-metastore/lib/guice-multibindings-4.1.0.jar:file:/opt/hive-metastore/lib/TokenLibrary-assembly-1.0.jar:file:/opt/hive-metastore/lib/hive-cli-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/hive-jdbc-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/zookeeper-3.4.11.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/regexp-1.3.jar:file:/opt/hive-metastore/lib/avro-1.7.7.jar:file:/opt/hive-metastore/lib/hive-hbase-handler-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/maven-settings-builder-3.1.1.jar:file:/opt/hive-metastore/lib/slider-core-0.90.2-incubating.jar:file:/opt/hive-metastore/lib/hbase-annotations-1.3.1.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/druid-hdfs-storage-0.9.2.jar:file:/opt/hive-metastore/lib/commons-pool-1.5.4.jar:file:/opt/hive-metastore/lib/jline-2.12.jar:file:/opt/hive-metastore/lib/hive-llap-tez-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/libthrift-0.9.3.jar:file:/opt/hive-metastore/lib/hive-vector-code-gen.jar:file:/opt/hive-metastore/lib/jta-1.1.jar:file:/opt/hive-metastore/lib/hbase-procedure-1.3.1.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/hive-accumulo-handler.jar:file:/opt/hive-metastore/lib/datanucleus-api-jdo-4.2.4.jar:file:/opt/hive-metastore/lib/hive-hcatalog-server-extensions-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/commons-compiler-2.7.6.jar:file:/opt/hive-metastore/lib/microsoft-catalog-metastore-client-1.0.44.jar:file:/opt/hive-metastore/lib/json4s-ast_2.11-3.5.3.jar:file:/opt/hive-metastore/lib/hive-llap-common-2.3.2.2.6.99.201-39240152-tests.jar:file:/opt/hive-metastore/lib/commons-el-1.0.jar:file:/opt/hive-metastore/lib/jasper-runtime-5.5.23.jar:file:/opt/hive-metastore/lib/commons-dbcp2-2.0.1.jar:file:/opt/hive-metastore/lib/tesla-aether-0.0.5.jar:file:/opt/hive-metastore/lib/joni-2.1.2.jar:file:/opt/hive-metastore/lib/super-csv-2.2.0.jar:file:/opt/hive-metastore/lib/guice-servlet-4.1.0.jar:file:/opt/hive-metastore/lib/hive-shims-0.23-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/javax.inject-1.jar:file:/opt/hive-metastore/lib/jersey-client-1.19.jar:file:/opt/hive-metastore/lib/hive-common.jar:file:/opt/hive-metastore/lib/jackson-dataformat-smile-2.4.6.jar:file:/opt/hive-metastore/lib/hbase-hadoop-compat-1.3.1.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/jackson-jaxrs-json-provider-2.4.6.jar:file:/opt/hive-metastore/lib/jackson-databind-2.6.5.jar:file:/opt/hive-metastore/lib/accumulo-core-1.6.0.jar:file:/opt/hive-metastore/lib/asm-commons-3.1.jar:file:/opt/hive-metastore/lib/jackson-jaxrs-1.9.13.jar:file:/opt/hive-metastore/lib/maven-model-3.1.1.jar:file:/opt/hive-metastore/lib/hive-jdbc-handler-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/jetty-continuation-9.2.5.v20141112.jar:file:/opt/hive-metastore/lib/jasper-compiler-5.5.23.jar:file:/opt/hive-metastore/lib/jcodings-1.0.8.jar:file:/opt/hive-metastore/lib/commons-vfs2-2.0.jar:file:/opt/hive-metastore/lib/hive-cli.jar:file:/opt/hive-metastore/lib/hive-llap-server-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/stax-api-1.0.1.jar:file:/opt/hive-metastore/lib/jackson-core-2.6.5.jar:file:/opt/hive-metastore/lib/aether-api-0.9.0.M2.jar:file:/opt/hive-metastore/lib/hive-beeline.jar:file:/opt/hive-metastore/lib/hive-serde.jar:file:/opt/hive-metastore/lib/log4j-slf4j-impl-2.6.2.jar:file:/opt/hive-metastore/lib/janino-2.7.6.jar:file:/opt/hive-metastore/lib/aether-impl-0.9.0.M2.jar:file:/opt/hive-metastore/lib/wagon-provider-api-2.4.jar:file:/opt/hive-metastore/lib/classmate-1.0.0.jar:file:/opt/hive-metastore/lib/metrics-jvm-3.1.0.jar:file:/opt/hive-metastore/lib/javolution-5.5.1.jar:file:/opt/hive-metastore/lib/geronimo-jta_1.1_spec-1.1.1.jar:file:/opt/hive-metastore/lib/jackson-annotations-2.6.0.jar:file:/opt/hive-metastore/lib/irc-api-1.0-0014.jar:file:/opt/hive-metastore/lib/derby-10.10.2.0.jar:file:/opt/hive-metastore/lib/calcite-linq4j-1.10.0.jar:file:/opt/hive-metastore/lib/derbyclient-10.11.1.1.jar:file:/opt/hive-metastore/lib/druid-processing-0.9.2.jar:file:/opt/hive-metastore/lib/accumulo-trace-1.6.0.jar:file:/opt/hive-metastore/lib/jsr305-3.0.0.jar:file:/opt/hive-metastore/lib/velocity-1.5.jar:file:/opt/hive-metastore/lib/jackson-datatype-guava-2.4.6.jar:file:/opt/hive-metastore/lib/activation-1.1.jar:file:/opt/hive-metastore/lib/hbase-hadoop2-compat-1.3.1.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/org.abego.treelayout.core-1.0.1.jar:file:/opt/hive-metastore/lib/javax.mail-1.6.1.jar:file:/opt/hive-metastore/lib/jetty-security-9.2.5.v20141112.jar:file:/opt/hive-metastore/lib/hive-accumulo-handler-2.3.2.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar:file:/opt/hive-metastore/lib/mapdb-1.0.8.jar:file:/opt/hive-metastore/lib/javax.el-3.0.0.jar:file:/opt/hive-metastore/lib/datanucleus-core-4.1.17.jar:file:/opt/hive-metastore/lib/hive-metastore.jar:file:/opt/hive-metastore/lib/oauth2-oidc-sdk-5.64.4.jar:file:/opt/hive-metastore/lib/jackson-datatype-joda-2.4.6.jar:file:/opt/hive-metastore/lib/maven-repository-metadata-3.1.1.jar:file:/opt/hive-metastore/lib/hive-llap-common.jar:file:/opt/hive-metastore/lib/commons-io-2.4.jar:file:/opt/hive-metastore/lib/json4s-scalap_2.11-3.5.3.jar:file:/opt/hive-metastore/lib/json-smart-2.3.jar:file:/opt/hive-metastore/lib/calcite-core-1.10.0.jar:file:/opt/hive-metastore/lib/json-1.8.jar:file:/opt/hive-metastore/lib/hive-service-rpc.jar:file:/opt/hive-metastore/lib/jsp-api-2.1.jar:file:/opt/hive-metastore/lib/druid-console-0.0.2.jar:file:/opt/hive-metastore/lib/log4j-web-2.6.2.jar:file:/opt/hive-metastore/lib/hbase-prefix-tree-1.3.1.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/maxminddb-0.2.0.jar:file:/opt/hive-metastore/lib/hbase-common-1.3.1.2.6.99.201-39240152.jar:file:/opt/hive-metastore/lib/jpam-1.1.jar:file:/opt/hive-metastore/lib/hive-llap-server.jar:file:/opt/hive-metastore/lib/jersey-server-1.14.jar:file:/opt/hive-metastore/lib/tempus-fugit-1.1.jar:file:/opt/hive-metastore/lib/jersey-core-1.19.jar:file:/opt/hive-metastore/lib/postgresql-metadata-storage-0.9.2.jar:file:/opt/hive-metastore/lib/jetty-io-9.2.5.v20141112.jar:file:/opt/hive-metastore/lib/jackson-xc-1.9.13.jar:file:/opt/hive-metastore/lib/ant-1.6.5.jar:file:/opt/hive-metastore/lib/log4j-jul-2.5.jar
21/06/23 01:42:09 INFO HiveConf: Found configuration file null
21/06/23 01:42:09 INFO SessionTokenBasedTokenProvider: Setting up conf
21/06/23 01:42:09 INFO SessionTokenBasedTokenProvider: SessionTokenBasedTokenProvider initialized
21/06/23 01:42:10 INFO SessionState: Created local directory: /mnt/var/hadoop/tmp/nm-local-dir/usercache/trusted-service-user/appcache/application_1624411145672_0003/container_1624411145672_0003_01_000001/tmp/trusted-service-user
21/06/23 01:42:10 INFO SessionState: Created HDFS directory: wasbs://@81v0q7545n99r09bgnqcz9y4.blob.core.windows.net/tmp/hive/trusted-service-user/bae2191f-b37f-459d-a303-8325ea68469f
21/06/23 01:42:10 INFO SessionState: Created local directory: /mnt/var/hadoop/tmp/nm-local-dir/usercache/trusted-service-user/appcache/application_1624411145672_0003/container_1624411145672_0003_01_000001/tmp/trusted-service-user/bae2191f-b37f-459d-a303-8325ea68469f
21/06/23 01:42:10 INFO SessionState: Created HDFS directory: wasbs://@81v0q7545n99r09bgnqcz9y4.blob.core.windows.net/tmp/hive/trusted-service-user/bae2191f-b37f-459d-a303-8325ea68469f/_tmp_space.db
21/06/23 01:42:10 INFO HiveClientImpl: Warehouse location for Hive client (version 2.3.3) is abfss://@occudlstorage.dfs.core.windows.net/synapse/workspaces/occudatalake/warehouse
21/06/23 01:42:10 INFO SynapseAuthFilter: instance SynapseAuthFilter with hive conf
21/06/23 01:42:10 INFO SynapseAuthFilter: hive proxy https://rpwestus.svc.datafactory.azure.com:44433
21/06/23 01:42:11 WARN DefaultTimer: Can not service-load a timer. Using JavaTimer instead.
21/06/23 01:42:11 INFO HiveMetastoreClientImp: check database exists or not: default
21/06/23 01:42:11 INFO ConvertRequestObjectToJsonFilter: Request body json string :{"HmsRuntimeProperties":{"SparkSessionToken":"eyJhbGciOiJodHRwOi8vd3d3LnczLm9yZy8yMDAxLzA0L3htbGRzaWctbW9yZSNyc2Etc2hhMjU2Iiwia2lkIjoiNkQ5QTU1NzA0MDFGNjAwQ0IyMTFBMjRCN0UzQzQxRUMyRUJCQjBGMiIsInR5cCI6IkpXVCJ9.eyJhdXRoVG9rZW4iOiJBQUVBRkcyYVZYQkFIMkFNc2hHaVMzNDhRZXd1dTdEeUFRQ0ZUdnh3YzEvRUNSeVZNQ3JrakpaRU1DRzlhV2pXWWRKQkJJNXcvZHZHLzllRjJlOWF6TTJEY1F3c0R5K3YwMnpMcTFYaUI1aDNuWWp1b2N5SnpCTDA2aFRTeFA3RndwbzBTd20zTTFMbDRuYlhSVTd3cTJ4dDJCSTBtZkt4aWFMOGhzeFdoY0NZTHprSkVkT3g3emtvZjdkeVdSMEFnQ2FGOGVETlgzVVd4OUd1NGZ4VnlNTFIvUi9PcjVNZ3dDWGsxcU5uZnZDUEdqcmh6MUJuNmpkdjh1aUtWNlNpb3hMUmhXN3dUd2Vuc2RNZ1NrTjRGR2FETjVZUVRRK2xVMW1IdUV3aXZoZi9TQXdTRG1OTXRuVWhJS3ZuUzV1em5iczdxK0krVW5LUis0anFDd0U0cGtzWGJpRHhwR0JmNk5LQTVjUG9iVzBFT1Fpb0RXcDZ0MHczQUJCTjlmVmZzWUJCdFAxQmRIVm5UNXlQQVRBdFAwa0drbUdkd2xuTkJIeTBlWHVybzkwVmIxSk1EVXo1WkhFcm9IV0JxVVBRYXJvQVJjQkxEYWFPdkR0cW1yOXUzczB0TjRWeHNzdjk4blkveUNqdWZiTzBKVS9qeUU2ZFZqS3JnV2JydnBzT2JIZUZQZ3pGNjZPdEZwMjNYbThEQTNaTTgvRE1oZmRBQ1lvcGNQK0xaU3Y2NjRKRnQvWERMK3grcjl2SGxRNFpXZ1ovelE3ODQ0RlFIc3JCL1BWT0ZxNzNSUDVaM2Z6RGpMZkNISHdSYU1QQ1FOUkt6U1NIbE4zK1hDM1dieXluQ1EwUFIyR3pNaEZQZkM4S0UrbTJsVDdpeGlKcFNuOU5Cak5YR3Yvd1VFWVlQMUxRR00wOFJycnd6WERKaURYTGRiL2ZFdnBSbkdZcnFFNTllZzhNeG5IN3VLS0ptTUFGc2NwalZGbHM3NHVNdU9tak9zcDZhVjdkVVYzOXBqTEIwM0V2MVNEdUJJQ0VVWWxMZVk3RUt2czBsNHVIMUJlQzVjbjBVbnlKIiwic2lnbmF0dXJlUGF5bG9hZCI6eyJ1c2VySWQiOiI0NTlmYzNjNi0xYjIxLTQwZWMtYjZjYy05YWU4M2UzY2I5Y2IiLCJqb2JJZCI6IjQiLCJjbHVzdGVySWQiOiJmZDZjNDIzYy00YWVmLTRjZDktOGQzYy00ZWNhYWE5M2I3M2YiLCJ3b3Jrc3BhY2VOYW1lIjoib2NjdWRhdGFsYWtlIiwiY29tcHV0ZU5hbWUiOiJsYXJnUG9vbDEiLCJqb2JUeXBlIjoiU3BhcmtTZXJ2aWNlU2Vzc2lvbiJ9fQ.Sx9OWMqc0Kl3j9J4U7Vsbi0clA82qnFslEsJN8EDLr5XBOqwgqtAP0oU_hiFc5KK1wYQhLlsc1aBn049X2MysWXzUATzKUQ4YptciyiOmmsPufDj6e_uKrwWJi6Eu3caprBMNw3UOyGOQZFuUdUpwatGH74Gfxq5dal5R2-YjqlzTL_JwipA7thdKyylmsJHbo_fQxPTOIUQrvAIzBZzulkWTwrkKB5Wbi6RzYFwdb6KTHyNN6XgloS33BD6nrzycT45EVRAJkQKvq6A2lpZme-sarkALxvqmIRBASWRr8rYl616ClbYggdCE84V3yyC1SVzaIrcCbPFOuVN9vRbzw"}}
21/06/23 01:42:11 INFO SasClient: Response headers : {Server=[Kestrel], X-Content-Type-Options=[nosniff], x-ms-gateway-request-id=[2143fb19-5884-4e0a-b60f-1f83d234e104], Pragma=[no-cache], x-ms-activity-id=[2143fb19-5884-4e0a-b60f-1f83d234e104], x-ms-correlation-request-id=[80b2dc7b-50f8-4f2f-b042-6ca2055e4e9a], Date=[Wed, 23 Jun 2021 01:42:11 GMT], x-ms-response-time-ms=[75], Strict-Transport-Security=[max-age=15724800; includeSubDomains], Cache-Control=[no-cache], Expires=[-1], Content-Length=[320], Content-Type=[application/json; charset=utf-8]}
21/06/23 01:42:11 INFO SasClient: method=GET path=https://tokenservice.westus.azuresynapse.net:443/api/v1/proxy/subscriptions/a392a704-e333-4fbb-8ec6-38d1e02b5b68/resourceGroups/OCCU-RG/providers/Microsoft.Synapse/workspaces/occudatalake/hms/databases/default?api-version=2019-06-01-preview contentType=application/json; charset=UTF-8 accept=application/json status=200
21/06/23 01:42:11 INFO SasClient: Response Str : {"Source":{"Location":"abfss://@occudlstorage.dfs.core.windows.net/synapse/workspaces/occudatalake/warehouse"},"Description":"Default Hive database","Origin":{"Type":"SPARK"},"Name":"default","EntityType":"DATABASE","PublishStatus":"PUBLISHED","ObjectVersion":1,"ObjectId":"0693e1e2-ae3c-4855-ba1e-213c7ada5f76"}
21/06/23 01:42:11 INFO HiveMetastoreClientImp: database default exists
21/06/23 01:42:11 INFO HiveMetastoreClientImp: Start to get database default
21/06/23 01:42:11 INFO ConvertRequestObjectToJsonFilter: Request body json string :{"HmsRuntimeProperties":{"SparkSessionToken":"eyJhbGciOiJodHRwOi8vd3d3LnczLm9yZy8yMDAxLzA0L3htbGRzaWctbW9yZSNyc2Etc2hhMjU2Iiwia2lkIjoiNkQ5QTU1NzA0MDFGNjAwQ0IyMTFBMjRCN0UzQzQxRUMyRUJCQjBGMiIsInR5cCI6IkpXVCJ9.eyJhdXRoVG9rZW4iOiJBQUVBRkcyYVZYQkFIMkFNc2hHaVMzNDhRZXd1dTdEeUFRQ0ZUdnh3YzEvRUNSeVZNQ3JrakpaRU1DRzlhV2pXWWRKQkJJNXcvZHZHLzllRjJlOWF6TTJEY1F3c0R5K3YwMnpMcTFYaUI1aDNuWWp1b2N5SnpCTDA2aFRTeFA3RndwbzBTd20zTTFMbDRuYlhSVTd3cTJ4dDJCSTBtZkt4aWFMOGhzeFdoY0NZTHprSkVkT3g3emtvZjdkeVdSMEFnQ2FGOGVETlgzVVd4OUd1NGZ4VnlNTFIvUi9PcjVNZ3dDWGsxcU5uZnZDUEdqcmh6MUJuNmpkdjh1aUtWNlNpb3hMUmhXN3dUd2Vuc2RNZ1NrTjRGR2FETjVZUVRRK2xVMW1IdUV3aXZoZi9TQXdTRG1OTXRuVWhJS3ZuUzV1em5iczdxK0krVW5LUis0anFDd0U0cGtzWGJpRHhwR0JmNk5LQTVjUG9iVzBFT1Fpb0RXcDZ0MHczQUJCTjlmVmZzWUJCdFAxQmRIVm5UNXlQQVRBdFAwa0drbUdkd2xuTkJIeTBlWHVybzkwVmIxSk1EVXo1WkhFcm9IV0JxVVBRYXJvQVJjQkxEYWFPdkR0cW1yOXUzczB0TjRWeHNzdjk4blkveUNqdWZiTzBKVS9qeUU2ZFZqS3JnV2JydnBzT2JIZUZQZ3pGNjZPdEZwMjNYbThEQTNaTTgvRE1oZmRBQ1lvcGNQK0xaU3Y2NjRKRnQvWERMK3grcjl2SGxRNFpXZ1ovelE3ODQ0RlFIc3JCL1BWT0ZxNzNSUDVaM2Z6RGpMZkNISHdSYU1QQ1FOUkt6U1NIbE4zK1hDM1dieXluQ1EwUFIyR3pNaEZQZkM4S0UrbTJsVDdpeGlKcFNuOU5Cak5YR3Yvd1VFWVlQMUxRR00wOFJycnd6WERKaURYTGRiL2ZFdnBSbkdZcnFFNTllZzhNeG5IN3VLS0ptTUFGc2NwalZGbHM3NHVNdU9tak9zcDZhVjdkVVYzOXBqTEIwM0V2MVNEdUJJQ0VVWWxMZVk3RUt2czBsNHVIMUJlQzVjbjBVbnlKIiwic2lnbmF0dXJlUGF5bG9hZCI6eyJ1c2VySWQiOiI0NTlmYzNjNi0xYjIxLTQwZWMtYjZjYy05YWU4M2UzY2I5Y2IiLCJqb2JJZCI6IjQiLCJjbHVzdGVySWQiOiJmZDZjNDIzYy00YWVmLTRjZDktOGQzYy00ZWNhYWE5M2I3M2YiLCJ3b3Jrc3BhY2VOYW1lIjoib2NjdWRhdGFsYWtlIiwiY29tcHV0ZU5hbWUiOiJsYXJnUG9vbDEiLCJqb2JUeXBlIjoiU3BhcmtTZXJ2aWNlU2Vzc2lvbiJ9fQ.Sx9OWMqc0Kl3j9J4U7Vsbi0clA82qnFslEsJN8EDLr5XBOqwgqtAP0oU_hiFc5KK1wYQhLlsc1aBn049X2MysWXzUATzKUQ4YptciyiOmmsPufDj6e_uKrwWJi6Eu3caprBMNw3UOyGOQZFuUdUpwatGH74Gfxq5dal5R2-YjqlzTL_JwipA7thdKyylmsJHbo_fQxPTOIUQrvAIzBZzulkWTwrkKB5Wbi6RzYFwdb6KTHyNN6XgloS33BD6nrzycT45EVRAJkQKvq6A2lpZme-sarkALxvqmIRBASWRr8rYl616ClbYggdCE84V3yyC1SVzaIrcCbPFOuVN9vRbzw"}}
21/06/23 01:42:11 INFO SasClient: Response headers : {Server=[Kestrel], X-Content-Type-Options=[nosniff], x-ms-gateway-request-id=[ddb1c444-387f-4122-862d-381572e39d44], Pragma=[no-cache], x-ms-activity-id=[ddb1c444-387f-4122-862d-381572e39d44], x-ms-correlation-request-id=[d5a15fc1-4e09-4593-bac6-959695b1aa65], Date=[Wed, 23 Jun 2021 01:42:11 GMT], x-ms-response-time-ms=[35], Strict-Transport-Security=[max-age=15724800; includeSubDomains], Cache-Control=[no-cache], Expires=[-1], Content-Length=[320], Content-Type=[application/json; charset=utf-8]}
21/06/23 01:42:11 INFO SasClient: method=GET path=https://tokenservice.westus.azuresynapse.net:443/api/v1/proxy/subscriptions/a392a704-e333-4fbb-8ec6-38d1e02b5b68/resourceGroups/OCCU-RG/providers/Microsoft.Synapse/workspaces/occudatalake/hms/databases/default?api-version=2019-06-01-preview contentType=application/json; charset=UTF-8 accept=application/json status=200
21/06/23 01:42:11 INFO SasClient: Response Str : {"Source":{"Location":"abfss://@occudlstorage.dfs.core.windows.net/synapse/workspaces/occudatalake/warehouse"},"Description":"Default Hive database","Origin":{"Type":"SPARK"},"Name":"default","EntityType":"DATABASE","PublishStatus":"PUBLISHED","ObjectVersion":1,"ObjectId":"0693e1e2-ae3c-4855-ba1e-213c7ada5f76"}
21/06/23 01:42:11 INFO HiveMetastoreClientImp: get database: {"source":{"provider":null,"location":"abfss://@occudlstorage.dfs.core.windows.net/synapse/workspaces/occudatalake/warehouse","properties":null},"description":"Default Hive database","owner":null,"ownerType":null,"origin":{"type":"SPARK","instanceId":null},"originObjectId":null,"objectId":"0693e1e2-ae3c-4855-ba1e-213c7ada5f76","objectVersion":1,"name":"default","entityType":"DATABASE","publishStatus":"PUBLISHED","properties":null}
21/06/23 01:42:11 INFO HiveMetastoreClientImp: Start to get table raw.savings
21/06/23 01:42:11 INFO ConvertRequestObjectToJsonFilter: Request body json string :{"HmsRuntimeProperties":{"SparkSessionToken":"eyJhbGciOiJodHRwOi8vd3d3LnczLm9yZy8yMDAxLzA0L3htbGRzaWctbW9yZSNyc2Etc2hhMjU2Iiwia2lkIjoiNkQ5QTU1NzA0MDFGNjAwQ0IyMTFBMjRCN0UzQzQxRUMyRUJCQjBGMiIsInR5cCI6IkpXVCJ9.eyJhdXRoVG9rZW4iOiJBQUVBRkcyYVZYQkFIMkFNc2hHaVMzNDhRZXd1dTdEeUFRQ0ZUdnh3YzEvRUNSeVZNQ3JrakpaRU1DRzlhV2pXWWRKQkJJNXcvZHZHLzllRjJlOWF6TTJEY1F3c0R5K3YwMnpMcTFYaUI1aDNuWWp1b2N5SnpCTDA2aFRTeFA3RndwbzBTd20zTTFMbDRuYlhSVTd3cTJ4dDJCSTBtZkt4aWFMOGhzeFdoY0NZTHprSkVkT3g3emtvZjdkeVdSMEFnQ2FGOGVETlgzVVd4OUd1NGZ4VnlNTFIvUi9PcjVNZ3dDWGsxcU5uZnZDUEdqcmh6MUJuNmpkdjh1aUtWNlNpb3hMUmhXN3dUd2Vuc2RNZ1NrTjRGR2FETjVZUVRRK2xVMW1IdUV3aXZoZi9TQXdTRG1OTXRuVWhJS3ZuUzV1em5iczdxK0krVW5LUis0anFDd0U0cGtzWGJpRHhwR0JmNk5LQTVjUG9iVzBFT1Fpb0RXcDZ0MHczQUJCTjlmVmZzWUJCdFAxQmRIVm5UNXlQQVRBdFAwa0drbUdkd2xuTkJIeTBlWHVybzkwVmIxSk1EVXo1WkhFcm9IV0JxVVBRYXJvQVJjQkxEYWFPdkR0cW1yOXUzczB0TjRWeHNzdjk4blkveUNqdWZiTzBKVS9qeUU2ZFZqS3JnV2JydnBzT2JIZUZQZ3pGNjZPdEZwMjNYbThEQTNaTTgvRE1oZmRBQ1lvcGNQK0xaU3Y2NjRKRnQvWERMK3grcjl2SGxRNFpXZ1ovelE3ODQ0RlFIc3JCL1BWT0ZxNzNSUDVaM2Z6RGpMZkNISHdSYU1QQ1FOUkt6U1NIbE4zK1hDM1dieXluQ1EwUFIyR3pNaEZQZkM4S0UrbTJsVDdpeGlKcFNuOU5Cak5YR3Yvd1VFWVlQMUxRR00wOFJycnd6WERKaURYTGRiL2ZFdnBSbkdZcnFFNTllZzhNeG5IN3VLS0ptTUFGc2NwalZGbHM3NHVNdU9tak9zcDZhVjdkVVYzOXBqTEIwM0V2MVNEdUJJQ0VVWWxMZVk3RUt2czBsNHVIMUJlQzVjbjBVbnlKIiwic2lnbmF0dXJlUGF5bG9hZCI6eyJ1c2VySWQiOiI0NTlmYzNjNi0xYjIxLTQwZWMtYjZjYy05YWU4M2UzY2I5Y2IiLCJqb2JJZCI6IjQiLCJjbHVzdGVySWQiOiJmZDZjNDIzYy00YWVmLTRjZDktOGQzYy00ZWNhYWE5M2I3M2YiLCJ3b3Jrc3BhY2VOYW1lIjoib2NjdWRhdGFsYWtlIiwiY29tcHV0ZU5hbWUiOiJsYXJnUG9vbDEiLCJqb2JUeXBlIjoiU3BhcmtTZXJ2aWNlU2Vzc2lvbiJ9fQ.Sx9OWMqc0Kl3j9J4U7Vsbi0clA82qnFslEsJN8EDLr5XBOqwgqtAP0oU_hiFc5KK1wYQhLlsc1aBn049X2MysWXzUATzKUQ4YptciyiOmmsPufDj6e_uKrwWJi6Eu3caprBMNw3UOyGOQZFuUdUpwatGH74Gfxq5dal5R2-YjqlzTL_JwipA7thdKyylmsJHbo_fQxPTOIUQrvAIzBZzulkWTwrkKB5Wbi6RzYFwdb6KTHyNN6XgloS33BD6nrzycT45EVRAJkQKvq6A2lpZme-sarkALxvqmIRBASWRr8rYl616ClbYggdCE84V3yyC1SVzaIrcCbPFOuVN9vRbzw"}}
21/06/23 01:42:11 INFO SasClient: Response headers : {Server=[Kestrel], X-Content-Type-Options=[nosniff], x-ms-gateway-request-id=[7788c5c4-85e5-417a-a488-27615060bcda], Pragma=[no-cache], x-ms-activity-id=[7788c5c4-85e5-417a-a488-27615060bcda], x-ms-correlation-request-id=[cb50b868-c372-41d9-be44-ae4f26485d84], Date=[Wed, 23 Jun 2021 01:42:11 GMT], x-ms-response-time-ms=[59], Strict-Transport-Security=[max-age=15724800; includeSubDomains], Cache-Control=[no-cache], Expires=[-1], Content-Length=[124], Content-Type=[application/json; charset=utf-8]}
21/06/23 01:42:11 INFO SasClient: method=GET path=https://tokenservice.westus.azuresynapse.net:443/api/v1/proxy/subscriptions/a392a704-e333-4fbb-8ec6-38d1e02b5b68/resourceGroups/OCCU-RG/providers/Microsoft.Synapse/workspaces/occudatalake/hms/databases/raw/artifacts/TABLE/savings?api-version=2019-06-01-preview contentType=application/json; charset=UTF-8 accept=application/json status=404
21/06/23 01:42:11 INFO HiveMetastoreClientImp: Cannot find table raw.savings
21/06/23 01:42:11 INFO TokenLibrary: Attempting to fetch access token from cache
21/06/23 01:42:11 WARN InMemoryCacheClient: Token not found in in-memory cache
21/06/23 01:42:11 INFO TokenLibrary: Invoking token service to fetch access token
21/06/23 01:42:11 INFO TokenLibrary: Fetching access token
21/06/23 01:42:12 INFO finagle: Finagle version 19.5.1 (rev=21b8a8b3eeca571eedc7094df53d5eb806856b61) built at 20190520-193515
21/06/23 01:42:12 INFO TokenLibrary: POST success
21/06/23 01:42:13 INFO InMemoryCacheClient: Token successfully cached in memory
21/06/23 01:42:13 INFO InMemoryFileIndex: It took 128 ms to list leaf files for 1 paths.
21/06/23 01:42:13 INFO HiveMetastoreClientImp: Start to get database raw
21/06/23 01:42:13 INFO ConvertRequestObjectToJsonFilter: Request body json string :{"HmsRuntimeProperties":{"SparkSessionToken":"eyJhbGciOiJodHRwOi8vd3d3LnczLm9yZy8yMDAxLzA0L3htbGRzaWctbW9yZSNyc2Etc2hhMjU2Iiwia2lkIjoiNkQ5QTU1NzA0MDFGNjAwQ0IyMTFBMjRCN0UzQzQxRUMyRUJCQjBGMiIsInR5cCI6IkpXVCJ9.eyJhdXRoVG9rZW4iOiJBQUVBRkcyYVZYQkFIMkFNc2hHaVMzNDhRZXd1dTdEeUFRQ0ZUdnh3YzEvRUNSeVZNQ3JrakpaRU1DRzlhV2pXWWRKQkJJNXcvZHZHLzllRjJlOWF6TTJEY1F3c0R5K3YwMnpMcTFYaUI1aDNuWWp1b2N5SnpCTDA2aFRTeFA3RndwbzBTd20zTTFMbDRuYlhSVTd3cTJ4dDJCSTBtZkt4aWFMOGhzeFdoY0NZTHprSkVkT3g3emtvZjdkeVdSMEFnQ2FGOGVETlgzVVd4OUd1NGZ4VnlNTFIvUi9PcjVNZ3dDWGsxcU5uZnZDUEdqcmh6MUJuNmpkdjh1aUtWNlNpb3hMUmhXN3dUd2Vuc2RNZ1NrTjRGR2FETjVZUVRRK2xVMW1IdUV3aXZoZi9TQXdTRG1OTXRuVWhJS3ZuUzV1em5iczdxK0krVW5LUis0anFDd0U0cGtzWGJpRHhwR0JmNk5LQTVjUG9iVzBFT1Fpb0RXcDZ0MHczQUJCTjlmVmZzWUJCdFAxQmRIVm5UNXlQQVRBdFAwa0drbUdkd2xuTkJIeTBlWHVybzkwVmIxSk1EVXo1WkhFcm9IV0JxVVBRYXJvQVJjQkxEYWFPdkR0cW1yOXUzczB0TjRWeHNzdjk4blkveUNqdWZiTzBKVS9qeUU2ZFZqS3JnV2JydnBzT2JIZUZQZ3pGNjZPdEZwMjNYbThEQTNaTTgvRE1oZmRBQ1lvcGNQK0xaU3Y2NjRKRnQvWERMK3grcjl2SGxRNFpXZ1ovelE3ODQ0RlFIc3JCL1BWT0ZxNzNSUDVaM2Z6RGpMZkNISHdSYU1QQ1FOUkt6U1NIbE4zK1hDM1dieXluQ1EwUFIyR3pNaEZQZkM4S0UrbTJsVDdpeGlKcFNuOU5Cak5YR3Yvd1VFWVlQMUxRR00wOFJycnd6WERKaURYTGRiL2ZFdnBSbkdZcnFFNTllZzhNeG5IN3VLS0ptTUFGc2NwalZGbHM3NHVNdU9tak9zcDZhVjdkVVYzOXBqTEIwM0V2MVNEdUJJQ0VVWWxMZVk3RUt2czBsNHVIMUJlQzVjbjBVbnlKIiwic2lnbmF0dXJlUGF5bG9hZCI6eyJ1c2VySWQiOiI0NTlmYzNjNi0xYjIxLTQwZWMtYjZjYy05YWU4M2UzY2I5Y2IiLCJqb2JJZCI6IjQiLCJjbHVzdGVySWQiOiJmZDZjNDIzYy00YWVmLTRjZDktOGQzYy00ZWNhYWE5M2I3M2YiLCJ3b3Jrc3BhY2VOYW1lIjoib2NjdWRhdGFsYWtlIiwiY29tcHV0ZU5hbWUiOiJsYXJnUG9vbDEiLCJqb2JUeXBlIjoiU3BhcmtTZXJ2aWNlU2Vzc2lvbiJ9fQ.Sx9OWMqc0Kl3j9J4U7Vsbi0clA82qnFslEsJN8EDLr5XBOqwgqtAP0oU_hiFc5KK1wYQhLlsc1aBn049X2MysWXzUATzKUQ4YptciyiOmmsPufDj6e_uKrwWJi6Eu3caprBMNw3UOyGOQZFuUdUpwatGH74Gfxq5dal5R2-YjqlzTL_JwipA7thdKyylmsJHbo_fQxPTOIUQrvAIzBZzulkWTwrkKB5Wbi6RzYFwdb6KTHyNN6XgloS33BD6nrzycT45EVRAJkQKvq6A2lpZme-sarkALxvqmIRBASWRr8rYl616ClbYggdCE84V3yyC1SVzaIrcCbPFOuVN9vRbzw"}}
21/06/23 01:42:13 INFO SasClient: Response headers : {Server=[Kestrel], X-Content-Type-Options=[nosniff], x-ms-gateway-request-id=[7d95a04d-0466-4fbf-a8b9-fff8059c07e4], Pragma=[no-cache], x-ms-activity-id=[7d95a04d-0466-4fbf-a8b9-fff8059c07e4], x-ms-correlation-request-id=[2c8a4b7d-c165-4c03-ad89-08e3f6735939], Date=[Wed, 23 Jun 2021 01:42:12 GMT], x-ms-response-time-ms=[38], Strict-Transport-Security=[max-age=15724800; includeSubDomains], Cache-Control=[no-cache], Expires=[-1], Content-Length=[318], Content-Type=[application/json; charset=utf-8]}
21/06/23 01:42:13 INFO SasClient: method=GET path=https://tokenservice.westus.azuresynapse.net:443/api/v1/proxy/subscriptions/a392a704-e333-4fbb-8ec6-38d1e02b5b68/resourceGroups/OCCU-RG/providers/Microsoft.Synapse/workspaces/occudatalake/hms/databases/raw?api-version=2019-06-01-preview contentType=application/json; charset=UTF-8 accept=application/json status=200
21/06/23 01:42:13 INFO SasClient: Response Str : {"Source":{"Location":"abfss://@occudlstorage.dfs.core.windows.net/synapse/workspaces/occudatalake/warehouse/raw.db"},"Description":"","Origin":{"Type":"SPARK"},"Properties":{},"Name":"raw","EntityType":"DATABASE","PublishStatus":"PUBLISHED","ObjectVersion":1,"ObjectId":"6f862a1f-3cfa-4d4a-9bda-4640aab06e33"}
21/06/23 01:42:13 INFO HiveMetastoreClientImp: get database: {"source":{"provider":null,"location":"abfss://@occudlstorage.dfs.core.windows.net/synapse/workspaces/occudatalake/warehouse/raw.db","properties":null},"description":"","owner":null,"ownerType":null,"origin":{"type":"SPARK","instanceId":null},"originObjectId":null,"objectId":"6f862a1f-3cfa-4d4a-9bda-4640aab06e33","objectVersion":1,"name":"raw","entityType":"DATABASE","publishStatus":"PUBLISHED","properties":{}}
21/06/23 01:42:13 INFO HiveMetastoreClientImp: Start to get table raw.savings
21/06/23 01:42:13 INFO ConvertRequestObjectToJsonFilter: Request body json string :{"HmsRuntimeProperties":{"SparkSessionToken":"eyJhbGciOiJodHRwOi8vd3d3LnczLm9yZy8yMDAxLzA0L3htbGRzaWctbW9yZSNyc2Etc2hhMjU2Iiwia2lkIjoiNkQ5QTU1NzA0MDFGNjAwQ0IyMTFBMjRCN0UzQzQxRUMyRUJCQjBGMiIsInR5cCI6IkpXVCJ9.eyJhdXRoVG9rZW4iOiJBQUVBRkcyYVZYQkFIMkFNc2hHaVMzNDhRZXd1dTdEeUFRQ0ZUdnh3YzEvRUNSeVZNQ3JrakpaRU1DRzlhV2pXWWRKQkJJNXcvZHZHLzllRjJlOWF6TTJEY1F3c0R5K3YwMnpMcTFYaUI1aDNuWWp1b2N5SnpCTDA2aFRTeFA3RndwbzBTd20zTTFMbDRuYlhSVTd3cTJ4dDJCSTBtZkt4aWFMOGhzeFdoY0NZTHprSkVkT3g3emtvZjdkeVdSMEFnQ2FGOGVETlgzVVd4OUd1NGZ4VnlNTFIvUi9PcjVNZ3dDWGsxcU5uZnZDUEdqcmh6MUJuNmpkdjh1aUtWNlNpb3hMUmhXN3dUd2Vuc2RNZ1NrTjRGR2FETjVZUVRRK2xVMW1IdUV3aXZoZi9TQXdTRG1OTXRuVWhJS3ZuUzV1em5iczdxK0krVW5LUis0anFDd0U0cGtzWGJpRHhwR0JmNk5LQTVjUG9iVzBFT1Fpb0RXcDZ0MHczQUJCTjlmVmZzWUJCdFAxQmRIVm5UNXlQQVRBdFAwa0drbUdkd2xuTkJIeTBlWHVybzkwVmIxSk1EVXo1WkhFcm9IV0JxVVBRYXJvQVJjQkxEYWFPdkR0cW1yOXUzczB0TjRWeHNzdjk4blkveUNqdWZiTzBKVS9qeUU2ZFZqS3JnV2JydnBzT2JIZUZQZ3pGNjZPdEZwMjNYbThEQTNaTTgvRE1oZmRBQ1lvcGNQK0xaU3Y2NjRKRnQvWERMK3grcjl2SGxRNFpXZ1ovelE3ODQ0RlFIc3JCL1BWT0ZxNzNSUDVaM2Z6RGpMZkNISHdSYU1QQ1FOUkt6U1NIbE4zK1hDM1dieXluQ1EwUFIyR3pNaEZQZkM4S0UrbTJsVDdpeGlKcFNuOU5Cak5YR3Yvd1VFWVlQMUxRR00wOFJycnd6WERKaURYTGRiL2ZFdnBSbkdZcnFFNTllZzhNeG5IN3VLS0ptTUFGc2NwalZGbHM3NHVNdU9tak9zcDZhVjdkVVYzOXBqTEIwM0V2MVNEdUJJQ0VVWWxMZVk3RUt2czBsNHVIMUJlQzVjbjBVbnlKIiwic2lnbmF0dXJlUGF5bG9hZCI6eyJ1c2VySWQiOiI0NTlmYzNjNi0xYjIxLTQwZWMtYjZjYy05YWU4M2UzY2I5Y2IiLCJqb2JJZCI6IjQiLCJjbHVzdGVySWQiOiJmZDZjNDIzYy00YWVmLTRjZDktOGQzYy00ZWNhYWE5M2I3M2YiLCJ3b3Jrc3BhY2VOYW1lIjoib2NjdWRhdGFsYWtlIiwiY29tcHV0ZU5hbWUiOiJsYXJnUG9vbDEiLCJqb2JUeXBlIjoiU3BhcmtTZXJ2aWNlU2Vzc2lvbiJ9fQ.Sx9OWMqc0Kl3j9J4U7Vsbi0clA82qnFslEsJN8EDLr5XBOqwgqtAP0oU_hiFc5KK1wYQhLlsc1aBn049X2MysWXzUATzKUQ4YptciyiOmmsPufDj6e_uKrwWJi6Eu3caprBMNw3UOyGOQZFuUdUpwatGH74Gfxq5dal5R2-YjqlzTL_JwipA7thdKyylmsJHbo_fQxPTOIUQrvAIzBZzulkWTwrkKB5Wbi6RzYFwdb6KTHyNN6XgloS33BD6nrzycT45EVRAJkQKvq6A2lpZme-sarkALxvqmIRBASWRr8rYl616ClbYggdCE84V3yyC1SVzaIrcCbPFOuVN9vRbzw"}}
21/06/23 01:42:13 INFO SasClient: Response headers : {Server=[Kestrel], X-Content-Type-Options=[nosniff], x-ms-gateway-request-id=[928d6b04-44cd-4bcb-a6de-cd0ce86ec445], Pragma=[no-cache], x-ms-activity-id=[928d6b04-44cd-4bcb-a6de-cd0ce86ec445], x-ms-correlation-request-id=[69733c7e-e443-4b29-9c70-c9074021ba4a], Date=[Wed, 23 Jun 2021 01:42:12 GMT], x-ms-response-time-ms=[54], Strict-Transport-Security=[max-age=15724800; includeSubDomains], Cache-Control=[no-cache], Expires=[-1], Content-Length=[124], Content-Type=[application/json; charset=utf-8]}
21/06/23 01:42:13 INFO SasClient: method=GET path=https://tokenservice.westus.azuresynapse.net:443/api/v1/proxy/subscriptions/a392a704-e333-4fbb-8ec6-38d1e02b5b68/resourceGroups/OCCU-RG/providers/Microsoft.Synapse/workspaces/occudatalake/hms/databases/raw/artifacts/TABLE/savings?api-version=2019-06-01-preview contentType=application/json; charset=UTF-8 accept=application/json status=404
21/06/23 01:42:13 INFO HiveMetastoreClientImp: Cannot find table raw.savings
21/06/23 01:42:13 INFO HiveMetastoreClientImp: Start to get database raw
21/06/23 01:42:13 INFO ConvertRequestObjectToJsonFilter: Request body json string :{"HmsRuntimeProperties":{"SparkSessionToken":"eyJhbGciOiJodHRwOi8vd3d3LnczLm9yZy8yMDAxLzA0L3htbGRzaWctbW9yZSNyc2Etc2hhMjU2Iiwia2lkIjoiNkQ5QTU1NzA0MDFGNjAwQ0IyMTFBMjRCN0UzQzQxRUMyRUJCQjBGMiIsInR5cCI6IkpXVCJ9.eyJhdXRoVG9rZW4iOiJBQUVBRkcyYVZYQkFIMkFNc2hHaVMzNDhRZXd1dTdEeUFRQ0ZUdnh3YzEvRUNSeVZNQ3JrakpaRU1DRzlhV2pXWWRKQkJJNXcvZHZHLzllRjJlOWF6TTJEY1F3c0R5K3YwMnpMcTFYaUI1aDNuWWp1b2N5SnpCTDA2aFRTeFA3RndwbzBTd20zTTFMbDRuYlhSVTd3cTJ4dDJCSTBtZkt4aWFMOGhzeFdoY0NZTHprSkVkT3g3emtvZjdkeVdSMEFnQ2FGOGVETlgzVVd4OUd1NGZ4VnlNTFIvUi9PcjVNZ3dDWGsxcU5uZnZDUEdqcmh6MUJuNmpkdjh1aUtWNlNpb3hMUmhXN3dUd2Vuc2RNZ1NrTjRGR2FETjVZUVRRK2xVMW1IdUV3aXZoZi9TQXdTRG1OTXRuVWhJS3ZuUzV1em5iczdxK0krVW5LUis0anFDd0U0cGtzWGJpRHhwR0JmNk5LQTVjUG9iVzBFT1Fpb0RXcDZ0MHczQUJCTjlmVmZzWUJCdFAxQmRIVm5UNXlQQVRBdFAwa0drbUdkd2xuTkJIeTBlWHVybzkwVmIxSk1EVXo1WkhFcm9IV0JxVVBRYXJvQVJjQkxEYWFPdkR0cW1yOXUzczB0TjRWeHNzdjk4blkveUNqdWZiTzBKVS9qeUU2ZFZqS3JnV2JydnBzT2JIZUZQZ3pGNjZPdEZwMjNYbThEQTNaTTgvRE1oZmRBQ1lvcGNQK0xaU3Y2NjRKRnQvWERMK3grcjl2SGxRNFpXZ1ovelE3ODQ0RlFIc3JCL1BWT0ZxNzNSUDVaM2Z6RGpMZkNISHdSYU1QQ1FOUkt6U1NIbE4zK1hDM1dieXluQ1EwUFIyR3pNaEZQZkM4S0UrbTJsVDdpeGlKcFNuOU5Cak5YR3Yvd1VFWVlQMUxRR00wOFJycnd6WERKaURYTGRiL2ZFdnBSbkdZcnFFNTllZzhNeG5I

Answer 4

Hi @Samara Soucy - MSFT

Is there any update on this? It's been 6 days and I'm still having the same issue.

Thanks for your help

Answer 5

2 Months, still no answer, is crazy that Microsoft releases a half baked service like this, I'm sure there are people with A lot more fields on a table than me