How to Create an AWS S3 Bucket for Databricks Developers
Introduction
We have discussed in our previous blogs that we created a user group and added some new IAM users to it. But, we did not assign any permission to the user group. In this blog I will show how to create an AWS S3 bucket for Databricks developers and set up the bucket so only the admin can access it.
Step 1: Create a New S3 Bucket
Firstly I will go to the S3 where there is a button named “Create bucket” which I will click on. I will give the bucket a name to be used, ‘db-demo’ and then choose a region to use. I will only change one setting whereby I will make sure that the box next to the option that reads ‘Block all public access’, is unchecked. I will also go and tick the box that shows that I understand the effects that come with it and then click on create bucket.
Step 2: Verify Bucket Creation
Now, that I have created the bucket, I can see it at the bottom of the list to the left and it is marked as created. Since I initiated this bucket through the root user, people who are not qualified to access this bucket cannot access it at all.I created this bucket using the root level then there is no way any other user will be able to access it since they do not have the right authorization.
Step 3: Verify User Permissions
To do this, I shall proceed to the IAM and choose a user at random. I have realized that the user has no permission on S3 bucket then it cannot read the new bucket created.