apm policy with saml using kerberos sso and sharepoint 2013 application

i am having an issue with the performance. I have an apm policy with saml the application it is connecting to is SharePoint 2013. so the Big-ip is the local sp and the external IDP is Azure. I imported the metafile from azure into the big-ip. I am using Kerberos sso. the SharePoint servers are set to negotiate. It seems like everything working but when it hits the SharePoint site. it hangs for like 25 to 30 second before it loads the page. or maybe it is logging into the page not sure. I think it may have something to do with the Kerberos sso. when I remove it SharePoint loads fast but then we don't have sso which we need. has anyone had this issues before?