Coding

AWS | Big Data | Athena Project | QuickSight

  • 00:00:00 hi I'm Manuel welcome back to the last
  • 00:00:04 video of our Athena project in the last
  • 00:00:07 video we learned how to use Athena so
  • 00:00:09 how do carry data with Athena that was
  • 00:00:12 stored before in s3
  • 00:00:13 we didn't take a look so far as an
  • 00:00:16 option how to visualize that information
  • 00:00:19 actually this is the purpose of this
  • 00:00:21 video we will take a look at how we can
  • 00:00:24 connect quick side the business
  • 00:00:26 intelligence tool of AWS to Athena
  • 00:00:28 let's do this right now
  • 00:00:34 one important information before we
  • 00:00:36 start if you never work with quick sides
  • 00:00:39 and you don't even know what it is just
  • 00:00:41 take a look at another video that I made
  • 00:00:43 in this video you will get an
  • 00:00:45 introduction to quick side and see how
  • 00:00:47 you can create an account as soon as you
  • 00:00:50 get this account you cannot start right
  • 00:00:52 here together with me so I am back in
  • 00:00:55 the management console here and we want
  • 00:00:58 to find quick side right now and
  • 00:01:00 selected right here now we are in quick
  • 00:01:03 side and as I said just make sure to
  • 00:01:06 take a look at the other video to
  • 00:01:08 understand what exactly you can see
  • 00:01:10 right here to make it quick this is just
  • 00:01:13 an overview of the existing analysis
  • 00:01:16 that I have in quick side now before we
  • 00:01:19 connect quick set to a phenom
  • 00:01:20 we have to make sure that a quick side
  • 00:01:22 has the right to access information that
  • 00:01:25 is stored in Athena now to do this we go
  • 00:01:27 to our settings right here and go to
  • 00:01:31 manage quick side right there in there
  • 00:01:35 we can go to G account settings right
  • 00:01:38 here here you can find the account
  • 00:01:40 permissions and if you click on to edit
  • 00:01:42 awx permissions right there and right
  • 00:01:44 here you can now enable quick side to be
  • 00:01:47 allowed to access of Emma's on Athena
  • 00:01:49 right here and also specify the s3
  • 00:01:53 buckets that quick side is allowed to
  • 00:01:55 access so make sure that you take all
  • 00:01:58 these boxes to be able to really analyze
  • 00:02:00 the data that you queried in Athena so
  • 00:02:04 if you click apply right general because
  • 00:02:05 it is totally fine
  • 00:02:08 then we can go back to the main menu and
  • 00:02:11 then we only have to make sure one thing
  • 00:02:14 and this one thing can be found right
  • 00:02:16 here in the regions we talked about that
  • 00:02:19 in the s3 video and in the Athena video
  • 00:02:22 but the important thing right here is
  • 00:02:23 that the region that you select for
  • 00:02:25 quick side is the same that you selected
  • 00:02:28 for Athena because otherwise the data
  • 00:02:30 that you have an Athena cannot be
  • 00:02:32 accessed by quick side so that's
  • 00:02:35 important keep that in mind before you
  • 00:02:37 start working in quick side right now
  • 00:02:39 now we made sure that we have the right
  • 00:02:41 settings so it's time to kind of
  • 00:02:43 retrieve that data now so to do this we
  • 00:02:46 need a data set and we can find it by
  • 00:02:49 going to new analysis and clicking onto
  • 00:02:52 new data set right here now you can see
  • 00:02:56 lots of different options where you can
  • 00:02:58 connect quick side you but we only want
  • 00:03:01 to take a look at Athena right here now
  • 00:03:04 if you click onto that then you can
  • 00:03:06 enter a name for the data source and now
  • 00:03:08 I will name that YouTube population oops
  • 00:03:12 Athena maybe and if you know click on to
  • 00:03:15 create data source right here then you
  • 00:03:20 can see that well quick side found the
  • 00:03:24 database and I have to say that again
  • 00:03:25 if the regions are not the same so the
  • 00:03:28 region for quick side and for Athena
  • 00:03:30 this won't work so make sure that these
  • 00:03:34 regions are the same however we got our
  • 00:03:36 database now and if you click on to
  • 00:03:38 select right here you can see that you
  • 00:03:41 can choose between the two databases
  • 00:03:42 that we have so the default one and the
  • 00:03:44 UT population is the one we need and now
  • 00:03:47 you can specify which table that you
  • 00:03:50 want to visualize in quick size out of
  • 00:03:52 these tables that you have in your
  • 00:03:54 database so this could be table 2 for
  • 00:03:56 example now you have two different
  • 00:03:58 options you can either press select or
  • 00:04:00 edit preview data the difference is that
  • 00:04:03 if you press select you will directly be
  • 00:04:06 able to visualize the data and if you
  • 00:04:09 press edit or preview data then you can
  • 00:04:11 prepare the data before you actually
  • 00:04:13 well load them into quick side and bite
  • 00:04:15 it visualize them so let's press edit
  • 00:04:17 preview data first to see if everything
  • 00:04:19 is correct and here
  • 00:04:22 now the data is loading yeah and I think
  • 00:04:26 this looks quite nice as I said this
  • 00:04:30 video is not about the details regarding
  • 00:04:31 the functionality the quick side it's
  • 00:04:33 more about the connection between quick
  • 00:04:35 side and the fina an important thing is
  • 00:04:37 maybe that you can specify if you want
  • 00:04:40 to create the data in the finance
  • 00:04:41 directly here or if you want to load the
  • 00:04:44 data into spice this is the internal
  • 00:04:47 memory or storage of quick side and this
  • 00:04:49 means that quick side treats the
  • 00:04:51 information in the Phenom as a database
  • 00:04:53 that's important to know and with that
  • 00:04:56 if you change the data source type to
  • 00:04:58 spice then you would be allowed to even
  • 00:05:01 join tables which are within the same
  • 00:05:03 database in quick side well if our data
  • 00:05:06 this doesn't make a lot of sense so we
  • 00:05:08 cannot use that join feature right here
  • 00:05:10 but what we can do is we can simply
  • 00:05:13 press until safe and visualize right
  • 00:05:15 there
  • 00:05:15 let's click onto that now we see that
  • 00:05:19 the information is imported into quick
  • 00:05:23 side and by that into spice as I said
  • 00:05:25 this is the internal memory click that
  • 00:05:28 has and this may take a few seconds so
  • 00:05:30 let's wait for that until the import is
  • 00:05:32 complete now the import is done and as
  • 00:05:36 you can see all data was imported
  • 00:05:39 correctly so we can now close that
  • 00:05:41 import complete method right here well
  • 00:05:43 and now simply create a chart for
  • 00:05:46 example let's create a bar chart
  • 00:05:48 something like that maybe and drag the
  • 00:05:52 time the x-axis and maybe the fuel
  • 00:05:58 population right here and the male
  • 00:06:01 population also right there you can see
  • 00:06:03 this add symbol that here so we can add
  • 00:06:05 the information well if we now close
  • 00:06:08 that field well maybe or before we close
  • 00:06:11 it let's open it and change the sorting
  • 00:06:13 because it's kind of wrong so we can
  • 00:06:15 change it right here like that and if
  • 00:06:18 you now increase the size maybe like
  • 00:06:21 that and also change number formatting
  • 00:06:25 sorry for that but I don't like that to
  • 00:06:27 be honest so let's change it right here
  • 00:06:29 like that it looks better right now it's
  • 00:06:32 good I think well then this is how you
  • 00:06:35 can
  • 00:06:35 now visualize information that you
  • 00:06:37 stored in s3 that you queried with
  • 00:06:40 Athena and that you then connected with
  • 00:06:43 quick sides to visualize it and if you
  • 00:06:46 now click right here onto this quick set
  • 00:06:48 symbol then you can find your analysis
  • 00:06:52 right here in this analysis menu and if
  • 00:06:56 you go to manage data right here then
  • 00:06:59 you can also find your data set right
  • 00:07:01 here saved in spice and this is it
  • 00:07:05 actually this is our afina project I
  • 00:07:08 hope you enjoyed this project and I hope
  • 00:07:11 that you saw how you can connect
  • 00:07:13 different AWS Big Data solutions with
  • 00:07:16 each other and how this whole workflow
  • 00:07:17 makes sense in the end you have two
  • 00:07:20 storage in s3 you have a Cena to query
  • 00:07:23 the information and you have quick site
  • 00:07:26 in the end to visualize the information
  • 00:07:28 and everything happens in the cloud and
  • 00:07:31 the calculation is not done on your
  • 00:07:34 machine so with that the only thing I
  • 00:07:37 can say right now is thankful for
  • 00:07:38 watching this series and for being part
  • 00:07:41 of it actually and I hope this helps you
  • 00:07:43 to clear some things up when working
  • 00:07:45 with some AWS solutions additionally
  • 00:07:48 this might also be a big help especially
  • 00:07:50 Athena if you have a big file that you
  • 00:07:53 want to analyze so if this happens the
  • 00:07:54 next time don't think only about Excel
  • 00:07:57 maybe also think about solutions like
  • 00:08:00 Athena because this can make your life a
  • 00:08:02 lot easier sometimes and with that I can
  • 00:08:05 only say thanks a lot for watching and
  • 00:08:07 hope to see you in the next videos bye
  • 00:08:10 bye