原文链接:www.gbase.cn/community/p…
更多精彩内容尽在南大通用GBase技术社区,南大通用致力于成为用户最信赖的数据库产品供应商。
南大通用GBase 8s数据库通过其内存数据仓库加速器(IWA)技术,为企业提供了一个高性能的解决方案。本系列文章将讲解IWA的基本概念,并详细介绍如何在南大通用GBase 8s中安装和配置IWA。
IWA概述
什么是IWA?
IWA(In-Memory Warehouse Accelerator,内存数据仓库加速器)是一种基于内存的数据仓库技术,它通过将数据加载到内存中来提高查询性能。与传统的磁盘存储相比,内存存储可以显著减少数据访问延迟,实现更快的数据处理速度。
本文将介绍GBase 8s 中IWA的安装部署,并给出使用IWA的详细示例。
IWA优势
快速响应: 利用内存的高速访问能力,IWA能够实现对复杂查询的快速响应。
并行处理: IWA支持多线程并行处理,进一步提高数据处理效率。
易于集成: IWA与GBase 8s数据库紧密集成,无需复杂的配置即可使用。
使用版本
本文使用的数据库版本和IWA的版本如下:
GBase8sV8.8_AEE_3.5.0_2O2_AP20230726_1_833699_RHEL6_x86_64.tar
IWA_AEE_3.5.0_2O2_AP20230726_1_833699_RHEL6_x86_64.tar
安装部署
1、安装数据库
首先解压安装包:
tar xvf GBase8sV8.8_AEE_3.5.0_2O2_AP20230726_1_833699_RHEL6_x86_64.tar
进行安装,安装过程如下,加粗部分是需要交互的。
[root@8s-225 setup]# ./ids_install
Preparing to install...
Extracting the JRE from the installer archive...
Unpacking the JRE...
Extracting the installation resources from the installer archive...
Configuring the installer for this system's environment...
Launching installer...
===============================================================================
GBase Software Bundle (created with InstallAnywhere)
Preparing CONSOLE Mode Installation...
===============================================================================
Getting Started
This application will guide you through the installation of GBase Software
Bundle.
Copyright General Data Corporation 2014, 2024. All rights reserved.
- Release Notes
The Release Notes can be found in
/opt/hyq/3.5.0_2O2_for_iwa/setup/doc/ids_unix_relnotes_12.10.html.
- Launch Information Center
Access the GBase Information Center at www.gbase.cn.
To Begin Installation, respond to each prompt to proceed to the next step in
the installation.
If you want to change something on a previous step, type 'back'.
You may cancel this installation at any time by typing 'quit'.
PRESS TO CONTINUE:
===============================================================================
License Agreement
Installation and Use of GBase Software Bundle Requires Acceptance of the
Following License Agreement:
Thank you for choosing GBase product!
Please read carefully the following licencing agreement before installing any
product: TIANJIN GENERAL DATA TECHNOLOGY CO. LTD. LICENSE AGREEMENT
READ THE TERMS OF THIS AGREEMENT AND ANY PROVIDED SUPPLEMENTAL LICENSETERMS
(COLLECTIVELY "AGREEMENT") CAREFULLY BEFORE OPENING THE SOFTWAREMEDIA PACKAGE.
BY OPENING THE SOFTWARE MEDIA PACKAGE, YOU AGREE TO THE TERMS OF THIS
AGREEMENT. IF YOU ARE ACCESSING THE SOFTWARE ELECTRONICALLY, INDICATE YOUR
ACCEPTANCE OF THESE TERMS. IF YOU DO NOT AGREE TO ALL THESE TERMS, PROMPTLY
RETURN THE UNUSED SOFTWARE TO YOUR PLACE OF PURCHASE FOR A REFUND.
- LICENSE TO USE. GeneralData grants you a non-exclusive and non-transferable
license for the internal use only of the accompanying software and
documentation and any error corrections provided by GeneralData(collectively
"Software"), by the number of users and the class of computer hardware for
which the corresponding fee has been paid.
- RESTRICTIONS. Software is confidential and copyrighted. Title to Software
PRESS TO CONTINUE:
and all associated intellectual property rights is retained by GeneralData
and/or its licensors. Except as specifically authorized in any Supplemental
License Terms, you may not make copies of Software, other than a single copy
of Software for archival purposes. Unless enforcement is prohibited by
applicable law, you may not modify, decompile, or reverse engineer Software.
You acknowledge that Software is not designed, licensed or intended for use in
the design, construction, operation or maintenance of any nuclear facility.
GeneralData disclaims any express or implied warranty of fitness for such
uses. No right, title or interest in or to any trademark, service mark, logo or
trade name of GeneralData or its licensors is granted under this Agreement.
- DISCLAIMER OF WARRANTY. Unless specified in this agreement, all express of
implied conditions, representations and warranties, including any implied
warranty of merchantability, fitness for aparticular purpose or
non-infringement are disclaimed, except to theextent that these disclaimers
are held to be legally invalid.
- LIMITATION OF LIABILITY. To the extent not prohibited by law, in no event
will GeneralData or its licensors be liable for any lost revenue, profit or
data, or for special, indirect, consequential, incidental orpunitive damages,
however caused regardless of the theory of liability, arising out of or
related to the use of or inability to use software, even if GeneralData has
PRESS TO CONTINUE:
been advised of the possibility of such damages. In no event will
GeneralData's libility to you, whether incontract, tort(including negligence),
or otherwise, exceed the amount paid by you for Software under this Agreement.
The foregoing limitations will apply even if the above stated warranty fails
of itsessential purpose.
- TERMINATION. This Agreement is effective until terminated. You may terminate
this Agreement at any time by destroying all copies of Software. This
Agreement will terminate immediately without noticefrom GeneralData if you
fail to comply with any provision of this Agreement. Upon Termination, you
must destroy all copies of Software.
- EXPORT REGULATIONS. All Software and technical data delivered under this
Agreement are subject to US export control laws and may be subject to export
or import regulations in other countries. You agree to comply strictly with
all such laws and regulations and acknowledge that you have the responsibility
to obtain such licenses to export, re-export, or import as may be required
after delivery to you.
- CHINESE * RESTRICTED. If Software is being acquired by or on behalf
PRESS TO CONTINUE:
of the Chinese *, then the * rights in Software and
accompanying documentation will be only as set forth in this Agreement.
- GOVERNING LAW. Any action related to this Agreement will be governed by
Chinese law: "COPYRIGHT LAW OF THE PEOPLE'S REPUBLIC OF CHINA", "PATENT LAW OF
THE PEOPLE'S REPUBLIC OF CHINA", "TRADEMARK LAW OF THE PEOPLE'S REPUBLIC OF
CHINA", "COMPUTER SOFTWARE PROTECTION REGULATIONS OF THE PEOPLE'S REPUBLIC OF
CHINA". No choice of law rules of any jurisdiction will apply."
- SEVERABILITY. If any provision of this Agreement is held to be
unenforceable, this Agreement will remain in effect with the provision
omitted, unless omission would frustrate the intent of the parties, in which
case this Agreement will immediately terminate.
- INTEGRATION. This Agreement is the entire agreement between you and
GeneralData relating to its subject matter. It supersedes all prior or
contemporaneous oral or written communications, proposals, representations and
warranties and prevails over any conflicting or additional terms of any quote,
order, acknowledgment, or other communication between the parties relating to
its subject matter during the term of this Agreement. No modification of this
Agreement will be binding, unless in writing and signed by an authorize
depresentative of each party. When the translation document has the different
PRESS TO CONTINUE:
meaning or has the conflicting views with Chinese original text conflict,
should take the laws and regulations promulgation unit as well as the
GeneralData issue Chinese original text as the standard.
All trademarks and registered trademarks mentioned herein are the property of
their respective owners.
DO YOU ACCEPT THE TERMS OF THIS LICENSE AGREEMENT? (Y/N): Y
===============================================================================
Installation Location
Choose location for software installation.
Default Install Folder: /opt/GBASE/gbase
ENTER AN ABSOLUTE PATH, OR PRESS TO ACCEPT THE DEFAULT
: /opt/hyq/3.5.0_2O2_for_iwa/ids
INSTALL FOLDER IS: /opt/hyq/3.5.0_2O2_for_iwa/ids
IS THIS CORRECT? (Y/N): Y
===============================================================================
Installation or Distribution
Select the installation type.
Typical: Install the database server with all features and a database server
that
is configured with default values. Includes:
** Client Software Development Kit (CSDK)
** Java Database Connectivity (JDBC)
Minimum disk space required: 700-800MB
Custom: Install the database server with specific features and software that
you need.
Optionally install a configured database server instance.
Minimum disk space required: 75 MB (without a server instance)
->1- Typical installation
2- Custom installation
3- Extract the product files (-DLEGACY option)
4- Create a RPM package for redistribution
ENTER THE NUMBER FOR YOUR CHOICE, OR PRESS TO ACCEPT THE DEFAULT::
===============================================================================
Server Instance Creation
Create a server instance?
->1- Yes - create an instance
2- No - do not create an instance
ENTER THE NUMBER FOR YOUR CHOICE, OR PRESS TO ACCEPT THE DEFAULT::
===============================================================================
Configuration - Number of Users
Select the number of expected database users.
->1- 1 - 100
2- 101 - 500
3- 501 - 1000
4- 1000+
ENTER THE NUMBER FOR YOUR CHOICE, OR PRESS TO ACCEPT THE DEFAULT::
===============================================================================
Ready To Install
InstallAnywhere is now ready to install GBase Software Bundle onto your system
at the following location:
/opt/hyq/3.5.0_2O2_for_iwa/ids
PRESS TO INSTALL:
===============================================================================
Installing...
[==================|==================|==================|==================]
[------------------|------------------|------------------|------------------]
===============================================================================
Server Initialization
The server will now be initialized. Initialization might take quite a while,
depending on the performance of your computer.
PRESS TO CONTINUE:
===============================================================================
Using the new instance
A database server instance was created. If you chose to initialize the
instance, it is ready to use.
You can open a command prompt to an initialized instance by running one of the
following commands at /opt/hyq/3.5.0_2O2_for_iwa/ids, where
ol_gbasedbt1210_20240807102321 is the path or filename of the instance.
Windows:
ol_gbasedbt1210_20240807102321.cmd
UNIX csh:
source ol_gbasedbt1210_20240807102321.csh
UNIX ksh or bourne:
./ol_gbasedbt1210_20240807102321.ksh
If initialization fails, check the online.log file for messages. The instance's
root chunk must be owned by the correct user and group, and it must have
readable and writable (rw) permission bits set only for owner and group.
PRESS TO CONTINUE:
===============================================================================
Installation Complete
Congratulations! GBase Software Bundle installation is complete.
Product install status:
GBase: Successful
GBase Connect: Successful
GBase 8s V8.8
For more information about using GBase products, see the GBase Information
Center at www.gbase.cn.
PRESS TO EXIT THE INSTALLER:
设定环境变量
需要设定环境变量,才能使用相关命令。
cd /opt/hyq/3.5.0_2O2_for_iwa/ids
source ol_gbasedbt1210_20240807102321.ksh
2、安装iwa
首先解压安装包:
tar xvf IWA_AEE_3.5.0_2O2_AP20230726_1_833699_RHEL6_x86_64.tar
进行安装,安装过程如下,加粗部分是需要交互的。
[root@8s-225 setup]# ./iwa_install
Preparing to install...
Extracting the JRE from the installer archive...
Unpacking the JRE...
Extracting the installation resources from the installer archive...
Configuring the installer for this system's environment...
Launching installer...
===============================================================================
GBase Warehouse Accelerator (created with InstallAnywhere)
Preparing CONSOLE Mode Installation...
===============================================================================
Introduction
InstallAnywhere will guide you through the installation of GBase Warehouse
Accelerator.
Copyright GBASE 2011, 2014. All rights reserved.
Respond to each prompt to proceed to the next step in the installation. If you
want to change something on a previous step, type 'back'.
You may cancel this installation at any time by typing 'quit'.
PRESS TO CONTINUE:
===============================================================================
License Agreement
Installation and Use of GBase Warehouse Accelerator Requires Acceptance of the
Following License Agreement:
Thank you for choosing GBase product!
Please read carefully the following licencing agreement before installing any
product: TIANJIN GENERAL DATA TECHNOLOGY CO. LTD. LICENSE AGREEMENT
READ THE TERMS OF THIS AGREEMENT AND ANY PROVIDED SUPPLEMENTAL LICENSETERMS
(COLLECTIVELY "AGREEMENT") CAREFULLY BEFORE OPENING THE SOFTWAREMEDIA PACKAGE.
BY OPENING THE SOFTWARE MEDIA PACKAGE, YOU AGREE TO THE TERMS OF THIS
AGREEMENT. IF YOU ARE ACCESSING THE SOFTWARE ELECTRONICALLY, INDICATE YOUR
ACCEPTANCE OF THESE TERMS. IF YOU DO NOT AGREE TO ALL THESE TERMS, PROMPTLY
RETURN THE UNUSED SOFTWARE TO YOUR PLACE OF PURCHASE FOR A REFUND.
- LICENSE TO USE. GeneralData grants you a non-exclusive and non-transferable
license for the internal use only of the accompanying software and
documentation and any error corrections provided by GeneralData(collectively
"Software"), by the number of users and the class of computer hardware for
which the corresponding fee has been paid.
- RESTRICTIONS. Software is confidential and copyrighted. Title to Software
PRESS TO CONTINUE:
and all associated intellectual property rights is retained by GeneralData
and/or its licensors. Except as specifically authorized in any Supplemental
License Terms, you may not make copies of Software, other than a single copy
of Software for archival purposes. Unless enforcement is prohibited by
applicable law, you may not modify, decompile, or reverse engineer Software.
You acknowledge that Software is not designed, licensed or intended for use in
the design, construction, operation or maintenance of any nuclear facility.
GeneralData disclaims any express or implied warranty of fitness for such
uses. No right, title or interest in or to any trademark, service mark, logo or
trade name of GeneralData or its licensors is granted under this Agreement.
- DISCLAIMER OF WARRANTY. Unless specified in this agreement, all express of
implied conditions, representations and warranties, including any implied
warranty of merchantability, fitness for aparticular purpose or
non-infringement are disclaimed, except to theextent that these disclaimers
are held to be legally invalid.
- LIMITATION OF LIABILITY. To the extent not prohibited by law, in no event
will GeneralData or its licensors be liable for any lost revenue, profit or
data, or for special, indirect, consequential, incidental orpunitive damages,
however caused regardless of the theory of liability, arising out of or
related to the use of or inability to use software, even if GeneralData has
PRESS TO CONTINUE:
been advised of the possibility of such damages. In no event will
GeneralData's libility to you, whether incontract, tort(including negligence),
or otherwise, exceed the amount paid by you for Software under this Agreement.
The foregoing limitations will apply even if the above stated warranty fails
of itsessential purpose.
- TERMINATION. This Agreement is effective until terminated. You may terminate
this Agreement at any time by destroying all copies of Software. This
Agreement will terminate immediately without noticefrom GeneralData if you
fail to comply with any provision of this Agreement. Upon Termination, you
must destroy all copies of Software.
- EXPORT REGULATIONS. All Software and technical data delivered under this
Agreement are subject to US export control laws and may be subject to export
or import regulations in other countries. You agree to comply strictly with
all such laws and regulations and acknowledge that you have the responsibility
to obtain such licenses to export, re-export, or import as may be required
after delivery to you.
- CHINESE *RESTRICTED. If Software is being acquired by or on behalf
PRESS TO CONTINUE:
of the Chinese *, then the *rights in Software and
accompanying documentation will be only as set forth in this Agreement.
- GOVERNING LAW. Any action related to this Agreement will be governed by
Chinese law: "COPYRIGHT LAW OF THE PEOPLE'S REPUBLIC OF CHINA", "PATENT LAW OF
THE PEOPLE'S REPUBLIC OF CHINA", "TRADEMARK LAW OF THE PEOPLE'S REPUBLIC OF
CHINA", "COMPUTER SOFTWARE PROTECTION REGULATIONS OF THE PEOPLE'S REPUBLIC OF
CHINA". No choice of law rules of any jurisdiction will apply."
- SEVERABILITY. If any provision of this Agreement is held to be
unenforceable, this Agreement will remain in effect with the provision
omitted, unless omission would frustrate the intent of the parties, in which
case this Agreement will immediately terminate.
- INTEGRATION. This Agreement is the entire agreement between you and
GeneralData relating to its subject matter. It supersedes all prior or
contemporaneous oral or written communications, proposals, representations and
warranties and prevails over any conflicting or additional terms of any quote,
order, acknowledgment, or other communication between the parties relating to
its subject matter during the term of this Agreement. No modification of this
Agreement will be binding, unless in writing and signed by an authorize
depresentative of each party. When the translation document has the different
PRESS TO CONTINUE:
meaning or has the conflicting views with Chinese original text conflict,
should take the laws and regulations promulgation unit as well as the
GeneralData issue Chinese original text as the standard.
All trademarks and registered trademarks mentioned herein are the property of
their respective owners.
DO YOU ACCEPT THE TERMS OF THIS LICENSE AGREEMENT? (Y/N): Y
===============================================================================
Installation Location
Where would you like to install GBase Warehouse Accelerator?
Default Install Folder: /opt/ibm/gbasedbt
ENTER AN ABSOLUTE PATH, OR PRESS TO ACCEPT THE DEFAULT
: /opt/hyq/3.5.0_2O2_for_iwa/ids
INSTALL FOLDER IS: /opt/hyq/3.5.0_2O2_for_iwa/ids
IS THIS CORRECT? (Y/N): Y
===============================================================================
Configuration choice
Would you like to configure GBase Warehouse Accelerator?
1- Yes
->2- No
ENTER THE NUMBER FOR YOUR CHOICE, OR PRESS TO ACCEPT THE DEFAULT::
===============================================================================
Pre-Installation Summary
Please Review the Following Before Continuing:
Product Name:
GBase Warehouse Accelerator
Install Folder:
/opt/hyq/3.5.0_2O2_for_iwa/ids
Product Features:
GBase Warehouse Accelerator
IWA storage directory
/opt/hyq/3.5.0_2O2_for_iwa/ids/dwa/demo
Starting port
21020
Number of nodes
2
Worker shared memory
500
Coordinator shared memory
250
Disk Space Information (for Installation Target):
Required: 115,999,848 Bytes
Available: 351,137,013,760 Bytes
PRESS TO CONTINUE:
===============================================================================
Installing...
[==================|==================|==================|==================]
[------------------|------------------|------------------|------------------]
===============================================================================
Configuration file information
The installer has not configured the accelerator. A copy of the default
configuration file for the accelerator is located at
/opt/hyq/3.5.0_2O2_for_iwa/ids/dwa/etc/dwainst.conf. You should review and
customize this file for your environment.
PRESS TO CONTINUE:
===============================================================================
Installation Complete
Congratulations. GBase Warehouse Accelerator has been successfully installed
to:
/opt/hyq/3.5.0_2O2_for_iwa/ids
PRESS TO EXIT THE INSTALLER:
3、配置ids
如果要使用iwa, 则ids的配置需要调整。
打开onconfig文件,
vi /opt/hyq/3.5.0_2O2_for_iwa/ids/etc/onconfig.ol_gbasedbt1210_20240807102321
加入如下内容:
VPCLASS dwavp,num=1,max=1,noage
然后重新启动ids。
onmode -ky
oninit -v
4、配置IWA
修改iwa的配置文件:
vi /opt/hyq/3.5.0_2O2_for_iwa/ids/dwa/etc/dwainst.conf
调整内容如下:
######################
#Set DWA Environent #
######################
#DWA storage directory
#Stores the catalog, marts, logs, traces etc.
DWADIR=/opt/hyq/3.5.0_2O2_for_iwa/ids/dwa/demo
#Starting port number
#Grows to START_PORT-1+NUM_NODES*4 .
START_PORT=21020
#Number of nodes (DWA_CM processes)
NUM_NODES=2
#Worker shared memory
#SHM (in Megabyte) for all worker nodes.
#Minimum value is 1 percent of physical memory.
WORKER_SHM=100
#Coordinator shared memory
#SHM (in Megabyte) for all coordinator nodes.
#Minimum value is 1 percent of physical memory.
COORDINATOR_SHM=100
#DRDA network interface
#For running the accelerator on a separate computer ask the system
#administrator for the network interface (e.g. eth0) that the GBasedbt
#database server should connect to, or run the ifconfig command to find the
#network interface.
DRDA_INTERFACE=lo
#Cluster network interface
#For running the accelerator distributed on different nodes of a cluster ask
#the system administrator for the network interface (e.g. eth0) that the
#accelerator should use, or run the ifconfig command to find the network
#interface.
#Activate this parameter only to setup and start the accelerator on a cluster.
#Prerequisits:
#Use a cluster filesystem like GPFS to share the accelerator software and the
#DWA storage directory DWADIR between the nodes of the accelerator.
#Configure ssh login without password between all cluster nodes for user root.
#Store a list of cluster nodes (hostnames), one node per line, in file
#$GBASEDBTDIR/dwa/etc/cluster.conf
#CLUSTER_INTERFACE=eth0
#CPU percentage for load specific threads
#Calculates parameter CORES_FOR_LOAD_THREADS_PERCENTAGE which limits the
#maximum number of threads that the load process is allowed to use for
#building histograms and compressing cellblocks:
#CORES_FOR_LOAD_THREADS_PERCENTAGE=CPU_PERCENTAGE_LOAD/NUM_NODES
#On cluster CORES_FOR_LOAD_THREADS_PERCENTAGE is set to CPU_PERCENTAGE_LOAD.
CPU_PERCENTAGE_LOAD=100
#CPU percentage for scan specific threads
#Calculates parameter CORES_FOR_SCAN_THREADS_PERCENTAGE which limits the
#maximum number of threads per machine that the query engine is allowed to
#use for scanning over cell block data:
#CORES_FOR_SCAN_THREADS_PERCENTAGE=CPU_PERCENTAGE_SCAN/NUM_NODES
#On cluster CORES_FOR_SCAN_THREADS_PERCENTAGE is set to CPU_PERCENTAGE_SCAN.
CPU_PERCENTAGE_SCAN=100
以上,通过本文的介绍,您应能了解IWA的基本概念和优势,并掌握了在GBase 8s中安装和配置IWA的基本步骤。IWA作为一种强大的内存数据仓库加速器,将为您的数据库应用带来性能提升。在下一篇中我们来谈谈IWA的具体使用。感谢您的阅读。
原文链接:www.gbase.cn/community/p…
更多精彩内容尽在南大通用GBase技术社区,南大通用致力于成为用户最信赖的数据库产品供应商。