WWW.THESIS.XLIBX.INFO
FREE ELECTRONIC LIBRARY - Thesis, documentation, books
 
<< HOME
CONTACTS



Pages:   || 2 |

«ORACLE ADVANCED COMPRESSION WITH ORACLE DATABASE 12C Introduction The amount of data that enterprises are storing and managing is growing rapidly - ...»

-- [ Page 1 ] --

Automatic Data Optimization with Oracle

Database 12c

ORACLE WHITE PAPER | JANUARY 2015

Table of Contents

Introduction 2

Storage Tiering and Compression Tiering 3

Heat Map -- Fine Grained Data Usage Tracking 4

Automatic Data Optimization 4

Conclusion 8

ORACLE ADVANCED COMPRESSION WITH ORACLE DATABASE 12C

Introduction

The amount of data that enterprises are storing and managing is growing rapidly - various industry estimates indicate that data volume is doubling every 2-3 years. The rapid growth of data presents daunting challenges for IT, both in cost and performance. Although the cost of storage keeps declining, fast-growing data volumes make storage one of the costliest elements of most IT budgets. In addition, the accelerating growth of data makes it difficult to meet performance requirements while staying within budget.

Information Lifecycle Management (ILM) is intended to address these challenges by storing data in different storage and compression tiers, according to the enterprise’s current business and performance needs. This approach offers the possibility of optimizing storage for both cost savings and maximum performance.

In Oracle Database 12c, two new ILM-related features have been added to the Advanced Compression option. Heat Map automatically tracks modification and query timestamps at the row and segment levels, providing detailed insights into how data is being accessed.

Automatic Data Optimization (ADO) automatically moves and compresses data according to user-defined policies based on the information collected by Heat Map.

Heat Map and ADO make it easy to use existing innovations in Oracle Database compression and partitioning technologies, which help reduce the cost of managing large amounts of data, while also improving application and database performance. Together these capabilities help to implement first-class Information Lifecycle Management in Oracle Database.

Storage Tiering and Compression Tiering An enterprise (or even a single application) does not access all its data equally: the most critical or frequently accessed data will need the best available performance and availability. To provide this best access quality to all the data would be costly, inefficient, and is often architecturally impossible. Instead, IT organizations implement storage tiering, by deploying their data on different tiers of storage so that less-accessed (“colder”) data are migrated away from the costliest and fastest storage – still available, but at slower speeds, whose effect on the overall application performance is minimal, due to the rarity of accessing those “colder” data. Colder data may also be compressed in storage. We use the term Information Lifecycle Management (ILM)1 to name the managing of data from creation/acquisition to archival or deletion.

Figure 1 shows the most active data located on a high performance tier and the less active data/historical data on lower-cost tiers. In this scenario, the business is meeting all of its performance, reliability, and security requirements, but at a significantly lower cost than in a configuration where all data is located on high performance (tier 1) storage. The illustration shows that compression can be applied to the less active and historical storage tiers, further improving the cost savings while also improving performance for queries that scan the less active data.

–  –  –

Figure 1 - Partitioning, Advanced Compression and Hybrid Columnar Compression.

In addition to storage tiering, it is also possible to use different types of compression to suit different access patterns. For example, colder data may be compressed more at the cost of slower access. Oracle Database provides several types of compression to help move data through its lifecycle - from hot to active to less active to historical – while meeting performance and availability requirements for the application. We call this compression tiering.

Even with the right storage and compression capabilities, deciding which data should reside where and when to migrate data from one tier to another remains a serious challenge. Oracle Database 12c addresses this challenge with functionality that automatically discovers data access patterns – Heat Map – and uses Heat Map information to automatically optimize data organization – Automatic Data Optimization. The rest of this See for example Gartner’s definition of ILM. Storage tiering, the practice of allocating different data to different levels of storage service, is one of the tools used for ILM.

document explains the Oracle Database technologies that enable storage and compression tiering, and how to use them to support Information Lifecycle Management.

Heat Map -- Fine Grained Data Usage Tracking Heat Map is a new feature in Oracle Database 12c that automatically tracks usage information at the row and segment levels.2 Data modification times are tracked at the row level and aggregated to the block level, and modification times, full table scan times, and index lookup times are tracked at the segment level. Heat Map gives you a detailed view of how your data is being accessed, and how access patterns are changing over time.

Programmatic access to Heat Map data is available through a set of PL/SQL table functions, as well as through data dictionary views.





Figure 2 shows one way to depict Heat Map data. Each box represents one partition of a table. The size of the box is the relative size of the partition, and the color represents how “hot” (i.e., frequently accessed) the partition is based on the most recent access to any row in the partition.

Figure 2 - Heat Map data for access patterns to a partitioned table

Automatic Data Optimization Automatic Data Optimization (ADO) allows you to create policies for data compression (Smart Compression) and data movement, to implement storage and compression tiering. Smart Compression refers to the ability to utilize Heat Map information to associate compression policies, and compression levels, with actual data usage.

Oracle Database periodically evaluates ADO policies, and uses the information collected by Heat Map to determine when to move and / or compress data. All ADO operations are executed automatically and in the background, without user intervention.

ADO policies can be specified at the segment or row level for tables and table partitions. Policies will be evaluated and executed automatically in the background during the maintenance window. ADO policies can also be evaluated and executed anytime by a DBA, manually or via a script.

Database rows are stored in database blocks, which are grouped in extents. A segment is a set of extents that contains all the data for a logical storage structure within a tablespace, i.e. a table or partition.

ADO policies specify what conditions (of data access) will initiate an ADO operation – such as no access, or no modification, or creation time – and when the policy will take effect – for example, after n days or months or years. Conditions in ADO policies are not limited to Heat Map data: you can also create custom conditions using PL/SQL functions, extending the flexibility of ADO to use your own data and logic to determine when to move or compress data.

Automatic Data Optimization Examples The following examples assume there is an orders table containing sales orders, and the table is range partitioned by order date.

In the first example, a segment-level ADO policy is created to automatically compress partitions using Advanced Row Compression after there have been no modifications for 30 days. This will automatically reduce storage used by older sales data, as well as improve performance of queries that scan through large numbers of rows in the older partitions of the table.

ALTER TABLE orders ILM ADD POLICY

ROW STORE COMPRESS ADVANCED SEGMENT

AFTER 30 DAYS OF NO MODIFICATION;

Sometimes it is necessary to load data at the highest possible speed, which requires creating a table without any compression enabled. It would be useful to later compress the data in the table, on a more granular basis than entire partitions. With ADO, you can create a row-level ADO policy to automatically compress blocks in the table (using Advanced Row Compression) after no row in a given block has been modified for at least 3 days.

This is an example of OLTP background compression, in which rows are inserted uncompressed, and then later moved to Advanced Row Compression on a per-block basis. Note that this policy uses the ROW keyword instead of the SEGMENT keyword.3 ALTER TABLE orders ILM ADD POLICY

ROW STORE COMPRESS ADVANCED ROW

AFTER 3 DAYS OF NO MODIFICATION;

With the above policy in place, Oracle Database will evaluate blocks in the orders table during the maintenance window, and any blocks that qualify will be compressed in place, freeing up space for new rows as they are inserted. This allows you to achieve the highest possible performance for data loads, but also get the storage savings and performance benefits of compression without having to wait for an entire partition to be ready for compression.

In addition to Smart Compression, ADO policy actions include data movement to other storage tiers, including lower cost storage tiers or storage tiers with other compression capabilities such as Oracle’ s Hybrid Columnar Compression (HCC).4 In the following example, a tablespace-level ADO policy automatically moves partitions to a different tablespace when the current tablespace runs low on space. The “tier to” keywords indicate that data will be moved to a new tablespace when the current tablespace becomes too full. The user has control over the threshold that triggers storage tiering actions with PL/SQL-based ILM admin functions. The “low_cost_store” tablespace was Advanced Row Compression is the only compression format supported for ROW policies.

HCC requires the use of Exadata Storage, Pillar Axiom, or Sun ZFS Storage Appliance.

created on a lower cost storage tier. Note that it is possible to add a custom condition to tiering policies, allowing you to trigger movement of data based on conditions other than how full the tablespace is.

ALTER TABLE orders ILM ADD POLICY tier to low_cost_store;

In the following example, a segment-level ADO policy is created to automatically compress partitions using Hybrid Columnar Compression after there have been no modifications for 30 days. This makes sense when HCC is available, and when the data will no longer be updated, but will continue to be queried; moving to HCC will save a lot of storage AND give a big boost to query performance.

–  –  –

Another option when moving a segment to another tablespace is to set the target tablespace to READ ONLY after the object is moved. This is beneficial for historical data and during backups, since subsequent RMAN full database backups will skip READ ONLY tablespaces.

Automatic Data Optimization for OLTP The previous examples show individual ADO policies that implement one action –compression tiering (Smart Compression) or storage tiering. The following example shows how to combing multiple ADO policies for an OLTP application.

In OLTP applications, you should use Advanced Compression for the most active tables/partitions, to ensure that newly added or updated data will be compressed as DML operations are performed against the active tables/partitions.

For cold or historic data within the OLTP tables, use either Warehouse or Archive Hybrid Columnar Compression. This ensures that data which is infrequently or never changed is compressed to the highest levels – compression ratios of 6x to 15x are typical with Hybrid Columnar Compression, whereas 2x to 4x compression ratios are typical with Advanced Row Compression.

For example, see Figure 3:

Figure 3 - Advanced Row Compression, Hybrid Columnar Compression, and tiering.

To implement this approach with ADO, use the following policies:

–  –  –

ALTER TABLE orders ILM ADD POLICY tier to low_cost_store;

In this example of Smart Compression and storage tiering, we assume that the orders table is defined with Advanced Row Compression enabled, so that rows are compressed at that level when they are first inserted.

Oracle Database will automatically evaluate the ADO policies to determine when each partition is eligible to be moved to a higher compression level, and when each partition is eligible to be moved to a lower cost storage tier. As discussed earlier, storage tiering is primarily triggered when the current tablespace becomes too full, but can be customized to occur based on user-defined conditions.

The capabilities of Heat Map and ADO in Oracle Database 12c make it easy for DBAs to implement ILM for OLTP applications, and enable the use of HCC with OLTP data. With HCC, DBAs can significantly reduce the amount of storage space used by OLTP data, while increasing the performance of reports and analytics.

Automatic Data Optimization for Data Warehousing

In data warehousing applications on Exadata storage, or on Oracle Storage that supports HCC, Warehouse Compression should be used for heavily queried tables/partitions. For cold or historic data within the data warehousing application, using Archive Compression ensures that data which is infrequently accessed is compressed to the highest level – compression ratios of 15x to 50x are typical with Archive Compression.

For example, see Figure 4:

Figure 4 - Partitioning and Hybrid Columnar Compression.

To implement this approach with ADO, use the following statements:

–  –  –

ALTER TABLE orders ILM ADD POLICY tier to lessactivetbs;



Pages:   || 2 |


Similar works:

«GIS-gestützte Analyse globaler Muster anthropogener Waldschädigung Eine sektorale Anwendung des Syndromkonzepts. von Martin Andreas Cassel-Gintz Potsdam-Institut für Klimafolgenforschung Telegrafenberg 14412 Potsdam Dissertation zur Erlangung des Grades „Doktor der Naturwissenschaften” am Fachbereich Geowissenschaften der Freien Universität Berlin Abgabe: 4. Dezember 2000 Disputation: 30. Januar 2001 Erstgutachter: Prof. Dr. Fred Scholz Freie Universität Berlin Zweitgutachter: Prof....»

«Pastor Search Committee Workbook (Designed by Dr. Lynn Eckeberger and Ed Hale) This workbook is also available as a download “Build your own Workbook” under the Resources tab at www.CPIS.org Church Personnel Information Services Church & Membership Resourcing Center Baptist General Convention of Texas Pastor Search Committee Workbook (Designed by Dr. Lynn Eckeberger and Ed Hale while serving as Director of Missions) I. Now That Our Pastor Has Left, What Should We Do First? II. Electing A...»

«. LOGIC FOR THE MATHEMATICAL Course Notes for PMATH 330—Spring/2006 PETER HOFFMAN Peter Hoffman c 2006 CONTENTS INTRODUCTION 5 1. THE LANGUAGE OF PROPOSITIONAL LOGIC 9 1.1 The Language. 11 1.2 Abbreviations. 16 2. RELATIVE TRUTH 23 2.1 Truth assignments and tables 23 2.2 Truth Equivalence of Formulae. 31 2.3 Validity of Arguments. 35 Program specification/software engineering 40 2.4 Satisfiability 42 2.5 Remarks on metalanguage vs. object language. 45 2.6 Associativity and...»

«ARTICULATA BEIHEFT 7 1998: 63 152 TAXONOMIE Taxonomie der Heuschrecken Deutschlands (Orthoptera): Formale Aspekte der w i s s e n s c h a f t l i c h e n Namen Armin Coray und Arne W. Lehmann Abstract Corrections and changements of the nomenclature of Orthoptera from Germany are made in this paper. W e have studied primary literature sources and base our conclusions on the International Code of Zoological Nomenclature (Code 1985). The considered names will be treated in independent sections....»

«No. 15-40238 IN THE UNITED STATES COURT OF APPEALS FOR THE FIFTH CIRCUIT STATE OF TEXAS, et al. Plaintiffs-Appellees, v. UNITED STATES OF AMERICA, et al. Defendants-Appellants. On appeal from the United States District Court Southern District of Texas Brownsville Division No. 1:14-cv-00254 (Andrew S. Hanen, J.) BRIEF FOR AMICI CURIAE THE MAYORS OF NEW YORK AND LOS ANGELES, SEVENTY-ONE ADDITIONAL MAYORS, CITIES, COUNTY OFFICIALS, COUNTIES, VILLAGES, AND BOROUGHS, THE UNITED STATES CONFERENCE OF...»

«1 Grundeinweisung Digitalfunk | Grundeinweisung Digitalfunk Gerätekunde und Taktik der Feuerwehren im Digitalfunk © Landesfeuerwehrund Katastrophenschutzschule Sachsen | Stand 13. Juni 2014 Grundeinweisung Digitalfunk | Ziel ❙ Ziel dieses Unterrichtes soll das Erlernen und Beherrschen der für eine sichere Bedienung der Funkgeräte im Digitalfunk notwendigen Grundkenntnisse sein. ❙ Außerdem das Verstehen und richtige Anwenden des Grundmodelles der Funktaktik der Feuerwehren im...»

«Discover PDF Book Introduction To Practice Of Statistics 6th Edition to Free Download, Save or Read Introduction To Practice Of Statistics 6th Edition document from top publisher INTRODUCTION TO PRACTICE OF STATISTICS 6TH EDITION PDF Download: INTRODUCTION TO PRACTICE OF STATISTICS 6TH EDITION PDF INTRODUCTION TO PRACTICE OF STATISTICS 6TH EDITION PDF Read story introduction to practice of statistics 6th edition PDF? You will be glad to know that right now introduction to practice of statistics...»

«Save As Universal Access In Human Computer Interaction Addressing Diversity with easy. Then You can Read eBook Universal Access In Human Computer Interaction Addressing Diversity file for free UNIVERSAL ACCESS IN HUMAN COMPUTER INTERACTION ADDRESSING DIVERSITY PDF Download: UNIVERSAL ACCESS IN HUMAN COMPUTER INTERACTION ADDRESSING DIVERSITY PDF Digital document UNIVERSAL ACCESS IN HUMAN COMPUTER INTERACTION ADDRESSING DIVERSITY File update. So you are person who likes to download universal...»

«GEMEINSAMER BERICHT des Vorstands der Biotest Aktiengesellschaft mit dem Sitz in Dreieich und der Geschäftsführung der Biotest Pharma GmbH mit dem Sitz in Dreieich über den Abschluss eines Beherrschungsund Ergebnisabführungsvertrags zwischen der Biotest Aktiengesellschaft mit dem Sitz in Dreieich und der Biotest Pharma GmbH mit dem Sitz in Dreieich entsprechend § 293a AktG 1. EINLEITUNG Die Biotest Aktiengesellschaft mit dem Sitz in Dreieich – nachstehend Biotest AG oder Organträgerin...»

«Testimony of Ina R. Drew Former Head of the Chief Investment Office, JPMorgan Chase & Co. Before the U.S. Senate Permanent Subcommittee on Investigations Washington, D.C. March 15, 2013 Good morning, Chairman Levin, Ranking Member McCain, and members of the Subcommittee. Thank you for the opportunity to meet and discuss with you my perspective on the losses incurred last year in JPMorgan Chase’s synthetic credit portfolio, one of many portfolios managed by the Company’s Chief Investment...»

«Lake District National Park Authority Agenda Item: 13 Rights of Way Committee: 16 January 2014 Page 1 APPLICATION TO MODIFY ALIGNMENT OF BRIDLEWAY 408002 AT LOW BIRKER, ESKDALE PARISH 1 Summary 1.1 The definitive map shows a bridleway passing through a link building between the barn and farmhouse at Low Birker. The route used until very recently follows a track around the north and west of the buildings. This report assesses the evidence as to whether an error was made when the bridleway was...»

«Pathways of Buddhist Thought Four Essays by Ñāṇamoli Thera Buddhist Publication Society Kandy • Sri Lanka The Wheel Publication No. 52/53 First Edition: 1963 Second Printing: 1983 BPS Online Edition © (2008) Digital Transcription Source: BPS Transcription Project For free distribution. This work may be republished, reformatted, reprinted and redistributed in any medium. However, any such republication and redistribution is to be made available to the public on a free and unrestricted...»





 
<<  HOME   |    CONTACTS
2016 www.thesis.xlibx.info - Thesis, documentation, books

Materials of this site are available for review, all rights belong to their respective owners.
If you do not agree with the fact that your material is placed on this site, please, email us, we will within 1-2 business days delete him.