topic Access AWS S3 bucket in Discussions

Access AWS S3 bucket

AT — Mon, 21 May 2018 16:35:30 GMT

Hi,

I like to use JMP14 and be able to import csv files on AWS S3 cloud. I did some search on JMP community and did not find what I want.

I do have ODBC on my MAC machine an can access AWS S3 files from commerical software such as Cyberduck.

I appreciate your help how to access S3 AWS. Thanks

Re: Access AWS S3 bucket

gzmorgan0 — Tue, 22 May 2018 01:29:53 GMT

Chapter 3 of book, Using JMP, describes connecting to databases using JMP. From the main menu, select Help>Books>Using JMP. Search for DSN or look on page 134. There is some setup to define the machine data source. If it has been definde by another program it is likely just needing some setup.

The JMP Scripting Language, the chapter on Extending JMP shows multilpe methods to script data extraction.

Re: Access AWS S3 bucket

AT — Tue, 22 May 2018 16:49:50 GMT

Thanks. My understanding is that AWS S3 is not a database (DB) and to access you need to put server address, key loging and etc in order to access the S3 bucket. I am familiar with how to access the database (DB) using ODBC from JMP. I was wondering if there is anyway to get access to S3 files using JMP. I appreciate any help. Thanks

Re: Access AWS S3 bucket

gzmorgan0 — Tue, 22 May 2018 17:56:52 GMT

AT,

Sorry for misreading your question. I do not know the path but let me provide you examples of accessing web file.

From a SpaceStation Tracking script written bt Xan Gregg and Craige Hales:

Open( "http://eoimages.gsfc.nasa.gov/images/imagerecords/55000/55167/earth_lights_lrg.jpg", "jpg" );

If you are using JMP 14, look up New HTTP Request() it creates a request to a web service. Other than trying the sample script, I have not explored this new feature, but it looks amazingingly useful.

Re: Access AWS S3 bucket

Daniel_Valente — Tue, 22 May 2018 19:28:14 GMT

Since you are running JMP 14, you may want to investigate the Python interface to JMP. Use Python to load the data into a Pandas DataFrame and then use Python Get(); to get you where you need in JMP. In the scripting index, there are some examples of the Python functions available in JSL.

Re: Access AWS S3 bucket

AT — Thu, 24 May 2018 13:37:19 GMT

Thanks. I tried Open and did not work but I used Web(""); and it is now asking on user credentials since it is AWS S3. I have attached what is needed.

I appreciate anty further help. Thanks

Re: Access AWS S3 bucket

AT — Tue, 22 May 2018 22:49:35 GMT

Thanks. I did some investigation and looks like I need boto3 library so that I can define the key ID and pass in Python and then run JMP to get the data I need.

Re: Access AWS S3 bucket

stan_koprowski — Tue, 22 May 2018 23:03:20 GMT

Hi @AT,

If all you need to do is access the S3 bucket / file system from your Mac I would use ExpanDrive (It is a commercially available utility).

ExpanDrive will allow you to mount the S3 bucket as it if were local to your Mac. Once mapped you should be able to drag and drop files the same as with any folder or cloud based folder.Access AWS S3

cheers,

Stan

Re: Access AWS S3 bucket

AT — Tue, 22 May 2018 23:19:13 GMT

Thanks Stan. I will definitely give it a try and let you know.