StarRocks Broker Load使用(S3同步)

282 阅读1分钟

从S3导入StarRocks 注意点:

  1. 字段需写上,不然容易导入报错。
  2. 换行符和列分隔符最好别用制表符和换行符,除非你能保证你的字段里没有这些字符。
LOAD LABEL  xxx.ad_group_load_prod_002
(
    DATA INFILE("s3://starrocks-tables/xxx/*")
    INTO TABLE t_amzdb_campaigns_ad_group_report
    COLUMNS TERMINATED BY ",,"
    ROWS  TERMINATED BY "|-|"
        (Id,UserId,AccountId,CampaignId,AdGroupId,Impressions,Clicks,TotalSpend,Orders,Sales,AllOrders,AllSales,BelongDate,
    CreateTime,UpdateTime,Site,TotalSpendUsd,SalesUsd,AllSalesUsd,Quantity,CampaignName,AdGroupName,PageView,ViewImpression,BidOptimization,
    NtbOrders,NtbSales)
)
WITH BROKER
(
    "aws.s3.use_instance_profile" = "false",
    "aws.s3.access_key" = "xxx",
    "aws.s3.secret_key" = "xxx",
    "aws.s3.region" = "cn-northwest-1"
)

PROPERTIES
(
    "max_filter_ratio" = "0.1"
);