Cloud Base Data Lake - Data Virtualization/Logical Data Lake

Executing [Implementation of the project]

64% complete, updated on Thu 9/7/23 3:49 PM by Lance Rivera

Changed Percent Complete from 63% to 64%.

Sep 7, 2023 | Cloud Data Lake Bi-Weekly Meeting

Notes

• Discuss current status of Projects:

  • Compunnel

    • Champion:  Nandita Signh

    • Current Status:  

      • Phase 2 & 3 are occurring concurrently

      • Workshop with Azure Aug 29th (Craig, Sam, Nandita)

        • Planning build out 

        • TSTC Zero account will go away and move to another MS Domain 

          • MS and AZURE consolidation will be taken as we move forward with Compunnel

          • Who will perform move to do determined

    • Next Steps:  

      • Data Factory proof to Production

        • Azure is a prerequisite for this step

          • Access to MS Eco Syste

          • m to Azure

      • N/A -Setup structured and semi structured data with Azure 

      • Contract to include Phase 3 approved and executed

      • 4 weeks to completion after Azure access

      • No further access anticipated

        • Tableau access was added to another 2 today

        • Workday access was put on hold for now

    • Anticipated completion date: 10/01/2023

  • Data Science Lab

    • Champion: George Makiya

    • Current Status:  Was on hold; now back on track

    • Next Steps:

      • Rediscovery meeting for team - 

      • Tonic access 

      • Architecture MS to assist in designing structure

        • Storage tiers classified - possible 3 tiers

      • Add NSC - National Student Clearing 

      • Google Analytics Data

      • Craig to setup another BI SQL Dev - in another couple of weeks

        • Only copy NSC data to this environment

    • Anticipated completion date:  TBD

  • Denodo

    • Champion:  Bill Holifield

    • Current Status:  Open cases

      • SP-TSA-8559-23-47

        • Workday to Denodo Financials needs caching and help!

          • Solution Offered

• SP-TSA-6210-23-47

  • Data Catalog Advisory Session with Inessa Gerber

    • Waiting for Customer Action

      • Bill will close this case

• SP-TSA-8192-23-47

  • Monitoring Framework

    • Assigned - In Progress

    • Need a fix for the monitoring agent startup issues.

• Next Steps:  Support mode; Solution is in operation

  • Monitoring framework hours

  • Consulting hours

• Anticipated completion date:  

  • Implementation is complete?

    • Audit to be reviewed by Bill & Craig

      • 1 hour session - 9/8 @ 9 am

    • Catalog

    • Data Mesh Assessment

    • Monitoring

  • Learning & Support for 3 years

    • Purchased 160 hours

• Informer 5

  • Champion: Michael LeRoux \ Tina Skidmore

  • Current Status:  Working with Regina (Entrinsik)

  • Next Steps: 

    • Login issue to bring in Entrinsik

      • Tina will enter ticket with Entrinsik

      • All in ver 5 test

    • Vendor access for Entrinsik

      • Lance to contact Regina

        • Access has already been granted 

    • Develop the Access Process between DnA and OIT

      • Development side of data sets 

      • Roles & permissions

        • Security Matrix

      • What does roll out look like

      • Who is responsible for what roles

    • Creating a Governance 

    • Migration to production

    • Phased approach

      • Student Enrollment

      • HR and Finance

  • Anticipated completion date:  Early Fall semester ‘23

• Microsoft Azure

  • Champion: Nandita Signh

  • Current Status:  See Compunnel

  • Next Steps:

    • SHI conversation 

      • Will bill month to month, Only SHI can see the billing info as they are the middle man

    • Should there be a Blanket PO or pay with a pcard

      • May need to work with Gladia on billing

  • Anticipated completion date:  

• Power BI Licenses

  • Currently 2 Tiers

    • Pro (25)

      • Consumers

    • Premium (30)

      • DnA Team

      • Executives

  • Power BI Production

    • Gateway connections

    • Access

  • Anticipated completion date:  09/21/23

  • Setup session on how to build connections for gateway

Action items

• Lance to contact Regina about credentials on Friday, 09/08/23
• Bill and Craig to meet about the Denodo audit on Friday, 09/08/23
• Craig to setup session on how to build connections for gateway
• Janine/Lance - check with Carrie and the workday project for EIV and General to see if it impacts anything we are doing here.