With the amount of data a business accumulates now doubling every 12 to 18 months, IT professionals need to know how to develop a system for archiving important database data, in a way that both satisfies regulatory requirements and is durable and secure. This important and timely new book explains how to solve these challenges without compromising the operation of current systems. It shows how to do all this as part of a standardized archival process that requires modest contributions from team members throughout an organization, rather than the superhuman effort of a dedicated team.
* Exhaustively considers the diverse set of issues-legal, technological, and financial-affecting organizations faced with major database archiving requirements.
* Shows how to design and implement a database archival process that is integral to existing procedures and systems.
* Explores the role of players at every level of the organization-in terms of the skills they need and the contributions they can make.
* Presents its ideas from a vendor-neutral perspective that can benefit any organization, regardless of its current technological investments.
* Provides detailed information on building the business case for all types of archiving projects
Inhaltsverzeichnis
1;Front Cover;1 2;Database Archiving How to Keep Lots of Data for a Very Long Time;4 3;Copyright Page;5 4;Dedication Page;6 5;Contents;8 6;Preface;14 6.1;How this Book is Organized;15 6.2;Organizations that are Likely to Need Database Archiving;16 6.3;Who this Book is for;16 7;Acknowledgments;18 8;Part 1: Archiving Basics;20 8.1;Chapter 1: Database Archiving Overview;22 8.1.1;1.1 A Definition of Database Archiving;23 8.1.2;1.2 Forms of Data Archiving;25 8.1.3;1.3 The Data Lifeline;31 8.1.4;1.4 Types of Data Objects;34 8.1.5;1.5 Data Retention Requirements Versus Data Archives;35 8.1.6;1.6 The Database Archives and Other Database Types;38 8.1.7;Summary;38 8.2;Chapter 2: The Business Case for Database Archiving;40 8.2.1;2.1 Why Database Archiving is a Problem Today;40 8.2.2;2.2 Implications of not Keeping Data;44 8.2.3;2.3 Data Volume Issues;46 8.2.4;2.4 Change Management;49 8.2.5;2.5 Current Database Archiving Practices;50 8.2.6;Summary;51 8.3;Chapter 3: Generic Archiving Methodology;52 8.3.1;3.1 The Methodology;52 8.3.2;3.2 Define Motivation for Archiving;54 8.3.3;3.3 Identify Objects to Archive;58 8.3.4;3.4 Determine When to Put Objects in the Archive;61 8.3.5;3.5 Determine How Long to Keep Objects in the Archive;63 8.3.6;3.6 Determine What to do with Discarded Objects;66 8.3.7;3.7 Determine Who Needs Access to Archives and How;66 8.3.8;3.8 Determine the Form of Archive Objects;67 8.3.9;3.9 Determine Where the Archive will be Kept;69 8.3.10;3.10 Determine Operational Processes Needed;76 8.3.11;3.11 Determine Necessary Administrative Processes;78 8.3.12;3.12 Determine Required Change Processes;78 8.3.13;Summary;79 8.4;Chapter 4: Components of a Database Archiving System;82 8.4.1;4.1 The Database Archiving Organization;82 8.4.2;4.2 Archive Application Data Gathering;83 8.4.3;4.3 Archive Application Design;84 8.4.4;4.4 Archive Data Extraction;84 8.4.5;4.5 Archive Data Management;85 8.4.6;4.6 Archive Access;85 8.4.7;4.7 Archive Administration;86 8.4.8;Summary;86 9;Part
2: Establishing a Database Archiving Project;88 9.1;Chapter 5: Origins of a Database Archiving Application;90 9.1.1;5.1 Problems that Lead to Database Archiving Solutions;91 9.1.2;5.2 Recognizing Problems;92 9.1.3;5.3 Assignment of Problems for Initial Study;94 9.1.4;5.4 Initial Problem Study Components;94 9.1.5;5.5 Determining the Basic Strategy for the Archiving Application;97 9.1.6;5.6 The Application Strategy Chart;102 9.1.7;Summary;102 9.2;Chapter 6: Resources Needed;104 9.2.1;6.1 People;104 9.2.2;6.2 Authority;106 9.2.3;6.3 Education;107 9.2.4;6.4 Repository;107 9.2.5;6.5 Archive Server;108 9.2.6;6.6 Software Tools;108 9.2.7;6.7 Disk Storage;109 9.2.8;Summary;110 9.3;Chapter 7: Locating Data;112 9.3.1;7.1 Inventorying Data;112 9.3.2;7.2 Picking the Archivist's Data;118 9.3.3;7.3 Documenting Data Sources;119 9.3.4;Summary;120 9.4;Chapter 8: Locating Metadata;122 9.4.1;8.1 Metadata Definitions;122 9.4.2;8.2 Where to Find Metadata;128 9.4.3;8.3 Selecting a Version of the Metadata;132 9.4.4;8.4 Classifying Data;133 9.4.5;8.5 Documenting Metadata;136 9.4.6;8.6 Keeping up with Changes;137 9.4.7;Summary;138 9.5;Chapter 9: Data and Metadata Validation;140 9.5.1;9.1 Matching Data to Metadata;140 9.5.2;9.2 Assessing Data Quality;142 9.5.3;9.3 Assessing Metadata Quality;143 9.5.4;9.4 Validating Data Classification;144 9.5.5;9.5 Documenting Validation Activities;144 9.5.6;9.6 Repeating Validation Activities;145 9.5.7;Summary;145 10;Part 3: Designing Database Archiving Applications;146 10.1;Chapter 10: Designing for Archive Independence;148 10.1.1;10.1 Independence from Application Programs;148 10.1.2;10.2 Independence from DBMS;151 10.1.3;10.3 Independence from Systems;152 10.1.4;10.4 Independence from Data Formats;152 10.1.5;Summary;154 10.2;Chapter 11: Modeling Archive Data;156 10.2.1;11.1 The Source Data Model;156 10.2.2;11.2 The Target Data Model;161 10.2.3;11.3 Model Representations;166 10.2.4;Summary;167 10.3;Chapter 12: Setting Archive Policies;168 10.3.1;12.1 Ext
ract Policies;168 10.3.2;12.2 Archive Storage Policies;173 10.3.3;12.3 Archive Discard Policies;176 10.3.4;12.4 Validation and Approval;178 10.3.5;Summary;178 10.4;Chapter 13: Changes to Data Structures and Policies;180 10.4.1;13.1 Archiving System Strategies for Handling Metadata Changes;180 10.4.2;13.2 Metadata Change Categories;182 10.4.3;13.3 Changes to the Archive Data Model;189 10.4.4;13.4 Managing the Metadata Change Process;190 10.4.5;13.5 Changes to Archive Policies;191 10.4.6;13.6 Maintaining an Audit Trail of Changes;195 10.4.7;Summary;196 11;Part 4: Database Archiving Application Software;198 11.1;Chapter 14: The Archive Data Store;200 11.1.1;14.1 Archive Database Choices;201 11.1.2;14.2 Important Features;204 11.1.3;14.3 False Features;212 11.1.4;14.4 How Choices Stack up;214 11.1.5;Summary;214 11.2;Chapter 15: The Archive Data Extraction Component;216 11.2.1;15.1 The Archive Extractor Model;217 11.2.2;15.2 Extractor Implementation Approaches;219 11.2.3;15.3 Execution Options;222 11.2.4;15.4 Integrity Considerations;224 11.2.5;15.5 Other Considerations;228 11.2.6;Summary;232 11.3;Chapter 16: The Archive Discard Component;234 11.3.1;16.1 Data Structure Considerations;234 11.3.2;16.2 Implementation Form;238 11.3.3;16.3 Integrity Considerations;239 11.3.4;16.4 Operational Considerations;241 11.3.5;16.5 Audit Trail;244 11.3.6;Summary;246 11.4;Chapter 17: The Archive Access Component;248 11.4.1;17.1 Direct Programming Access;248 11.4.2;17.2 Access Through Generic Query and Search Tools;250 11.4.3;17.3 Access Through Report Generators and BI Tools;250 11.4.4;17.4 Selective Data Unload;251 11.4.5;17.5 Accessing Original Data;253 11.4.6;17.6 Metadata Services;255 11.4.7;17.7 Other Access Considerations;255 11.4.8;Summary;257 12;Part 5: Administration of the Database Archive;260 12.1;Chapter 18: Ongoing Auditing and Testing;262 12.1.1;18.1 Responsibility for Ongoing Auditing and Testing;263 12.1.2;18.2 Auditing Activities;263 12.1.3;18.3 Testing Activities;267 1
2.1.4;18.4 Frequency of Audits and Tests;269 12.1.5;Summary;269 12.2;Chapter 19: Managing the Archive Over Time;270 12.2.1;19.1 Managing the Archive Database;270 12.2.2;19.2 Managing the Archive Repository;272 12.2.3;19.3 Using Hosted Solutions;274 12.2.4;19.4 Managing Archive Users;275 12.2.5;Summary;278 12.3;Chapter 20: Nonoperational Sources of Data;280 12.3.1;20.1 Retired Applications;280 12.3.2;20.2 Data from Mergers and Acquisitions;282 12.3.3;20.3 e-Discovery Applications;283 12.3.4;20.4 Business Intelligence Data;285 12.3.5;20.5 Logs, Audit Trails, and Other Miscellaneous Stuff;286 12.3.6;Summary;287 13;Final Thoughts;288 14;Appendix A: Generic Archiving Checklist;290 15;Appendix B: Goals of a Database Archiving System;294 16;Appendix C: Job Description of a Database Archive Analyst;296 16.1;Position;296 16.2;Job Responsibilities;296 16.3;Required Qualifications;297 16.4;Other Helpful Qualifications and Characteristics;297 17;Glossary;298 18;References;302 19;Index;304
