Project Overview
The initial requirement was to implement an APC data workflow through to national dataset submission. There was no current data feed for this information and was not a dataset or workflow that the organisation was familiar with.
By implementing new data flows and improving data quality it subsequently led to other possibilities to automate NAC data flows and make large potential cost savings.
Data Warehousing
Modality had a large reliance upon manual data transcription between their SystmOne environment and their reporting database and at the time processes were only in place to capture NAC data via system downloads and manual data entry.
A new on-premise SQL server database was designed and utilising SSIS integration tools was configured to load all activity deltas on a nightly basis for all activity and demographic data covering both APC and NAC datasets. All aspects of the data load process including troubleshooting information was documented and handed over to the on-site team.
Data Quality Review
By reviewing current NAC CDS data submissions and associated processes it was clear there was definite room for improvement in terms of the data quality. This was further aided by the heavy reliance of manual transcription of data into the on site reporting database which ultimately was responsible for a not so desirable performance in the organisation's DQMI targets.
A field by field review was performed and matched back to original data systems clearly highlighting there were multiple "sources of truth". Processes were re-written in the view of taking out human interpretation from the equation. Subsequently there have been huge improvements in the organsisation's DQMI performance and also in internal and external visibility of patient outcomes.
The data review was fed back and configuration changes were made directly onto the PAS system which in turn has seen Modality LLP become one of the best performing organisations in terms of data quality.
Reporting
With APC being a new dataset for the organisation there were no reports currently configured to see what activity was being recorded and also their associated income tariffs.
Both activity reports and data quality reports were produced and implemented using their pre-existing reporting services environment.
Due to the success of these new reports, reports were then designed and produced to replicate current manual front-end processes. These were made available to the team quickly and accurately and dramatically sped up the current manual processes whilst transition to NAC reporting directly from the new data warehouse was being planned and developed.
Results
The overall project saw the NAC DQMI performance increase from a 35% dataset score to 100% making one of the worst performing organisations now one of the best.
The project also came with the benefit of large resource savings and in turn costs by removing manual tasks and ensured accuracy in tariff allocation under PbR.
Project Overview
The project requirement was to migrate the council data and databases from legacy housing infrastructure to new corporate infrastructure. This would include migrating all applications and databases from legacy servers to new servers on the new infrastructure
Database Consolidation
The first step was to consolidate a number of databases to ensure it was easier to manage in future for the current in-house team. There were 76 databases in total, and all databases were monitored to ensure active databases are consolidated and unused databases were archived and decommissioned.
Data Processing Improvements
The extraction processes every night were taking a very long time (at least 12 hours every night) and when there were any technical issues it was proving difficult to re-run the current processes and to catchup during the working day. These processes were reviewed to understand the root cause and subsequently the processes were changed to ensure it finished in 3 hours instead of 12 hours. This improvement also enabled the process to be easily restarted during a day to refresh data in cubes, reports and dashboard across council in the event of any unforeseen circumstances.
Database Migration
All databases were migrated from legacy servers of SQL server 2005 to SQL Server 2012. Any unused databases, cube reports and SSRS reports were decommissioned. New reports were set up in line with the requirements from the business users.
Results
The Sandwell council achieved the following advantages from the project:
• The number of SQL servers was reduced from three to one enabling easier maintenance
• The number of databases as a result of the consolidation resulted in the reduction in the total number to 20 from the previous 76
• The extraction process over night was now taking 3 hours instead of the previous 12 hours
• New reports/alerts were set up to improve data quality across various datasets and sources