AWS (Amazon Web Services) is a comprehensive, evolving cloud computing platform provided by Amazon that includes a mixture of infrastructure as a service (IaaS), platform as a service (PaaS) and packaged software as a service (SaaS) offerings.Lucidum uses the AWS connector to ingest data from the following AWS services:
-
AWS Database Services (DynamoDB)
-
AWS EC2 Instance
-
AWS IAM User/Policy
-
AWS EKS Kubernetes Service
-
AWS ECS Container Service
-
AWS S3 File Storage
-
AWS Inspector
-
AWS Logs (CloudWatch/CloudTrail)
-
AWS ELB Load Balancer
-
AWS Elastic Network Interface
-
AWS Security Groups
-
AWS Route53
-
AWS Lambda Function
-
AWS Config
-
AWS Organizations
-
AWS Elastic Cache
-
AWS Workspaces
Requirements #
There are two ways to use the AWS Connector in Lucidum:
-
You can configure a single connector profile to ingest data data from multiple AWS accounts. To do this, you define cross-account access that allows Lucidum to ingest information from multiple AWS accounts.
- You can configure a single connector profile to ingest data from a single AWS account you want to ingest information from. You can then create multiple connector profiles, each ingesting data from a specific AWS account.
For both options, you must then configure the AWS connector in Lucidum and start ingesting data from AWS. This is described in each section.
Configure a Single Connector Profile to Ingest from Multiple AWS Accounts #
If you want to use a single Lucidum connector profile to ingest data from multiple AWS accounts, perform these steps.
Video (8 minutes) #
https://lucidum.io/wp-content/uploads/configuring_aws_connector_for_multi_acounts_compressed.mp4?_=3
Required Configuration Tasks in AWS (4-5 minutes for each AWS account you want Lucidum to ingest from) #
1. Copy JSON file from Lucidum’s Private github. |
|
2. Get the 12-digit AWS account ID for your Lucidum instance. |
|
3. Log in to the AWS console |
|
4. Note the AWS region in the URL. |
https://us-east-1.console.aws.amazon.com/billing/home#/account
|
5. Click IAM > Policies > Create Policy. | |
6. In the Specify Permissions page: |
|
7. In the Review and create page: |
|
8. Click IAM > Roles > Create role. | |
9. In the Select trusted entity page: |
|
10. In the Add Permission page: |
|
11. In the Name, review, and Create page: |
|
12. Click IAM > Roles. | |
13. In the Role page: |
|
14. Click the Admin name in the upper right corner. |
|
15. Repeat these steps for each AWS account you want to ingest data from. |
|
Configuring the AWS Connector in Lucidum (3 minutes) #
- Login to Lucidum
- In the left menu bar, click the Connectors icon
- In the Connectors page, click on the tile for AWS.
- In the Settings page, go to the Configured Profiles Click the Add New Profile (plus-sign) icon.
- In the right pane, provide values in the following fields:
Field | Description | Example |
Profile Name | A name for the Connector profile. | lucidum_cross_account |
External Role ID | Provide the value of External ID from step 9 above. | lucidum-access |
Role Duration | Provide the value from Maximum session duration in step 13 above | 4 |
Role Name | Provide the value from Role name from step 11 above | lucidum-assume-role |
AWS Accounts | One or more AWS account IDs from step 14 above. After entering an account ID, press the Return key. You can then enter another account ID. | 365329389986, 456789239998, 769943206052 |
Auto Scaling Regions | Optional Specify the regions where you have implemented AWS Auto Scaling. | us-east1 |
AWS Regions | Enter the AWS Region codes from step 4 above. After entering an AWS region, press the Return key. You can then enter another AWS region. | us-east1, us-east2 |
- Click Save.
- Click Test.
Configure a Single Connector Profile for a Single AWS Account #
If you want to use Lucidum to ingest data from only a single AWS account or if you want to create a connector profile for each AWS account, perform these steps.
Video (6 minutes) #
Required Configuration Tasks in AWS (4-5 minutes) #
1. Copy JSON file from Lucidum’s Private github. |
|
2. Get the 12-digit AWS account ID for your Lucidum instance. |
|
3. Log in to the AWS console. |
|
4. Note the AWS region in the URL. |
|
5. Click IAM > Policies > Create Policy. | |
6. In the Specify Permissions page: |
|
7. In the Review and create page: |
|
8. Click IAM > Users > Create user. | |
9. In the User Details page: |
|
10. In the Set Permission page: |
|
11. In the Review, and Create page |
|
12. Click IAM > Users. | |
13. In the Users page: |
|
14. In the IAM > Users > user name page: |
|
15. In the Access key best practices & alternatives page: |
|
16. In the Set description tag page: |
|
17. In the Retrieve access key page: |
|
18. Click the Admin name in the upper right corner. |
|
Configuring the AWS Connector in Lucidum (3 minutes) #
- Login to Lucidum
- In the left menu bar, click the Connectors icon
- In the Connectors page, click on the tile for AWS.
- In the Settings page, go to the Configured Profiles Click the Add New Profile (plus-sign) icon.
- In the right pane, provide value in the following fields:
Field | Description | Example |
Profile Name | A name for the Connector profile | AWS Single Account |
Access Key ID | Enter the value for Access Key ID from the .CSV file in step 17 above. | AKIAVRUVPPLUQO4ZZ772 |
Access Key Secret | Enter the value for Access Key Secret from the .CSV file in step 17 above. | wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY |
AWS Account | Enter the AWS Account ID from step 18 above | 769943206052 |
Auto Scaling Regions | Optional. Specify the regions where you have implemented AWS Auto Scaling. | us-east1 |
AWS Regions | Enter the AWS Region code from step 4 above | us-east1 |
- Click Save.
- Click Test.
Source Documentation #
Creating a Policy and Creating Roles #
https://docs.aws.amazon.com/IAM/latest/UserGuide/access_policies_create-console.html
API Documentation #
https://docs.aws.amazon.com/cloudcontrolapi/
https://docs.aws.amazon.com/AWSEC2/latest/APIReference/Welcome.html
https://docs.aws.amazon.com/AmazonS3/latest/API/Welcome.html