Jupyter Extension makes Script Table Operators easy with Magics

Teradata SQL Extension for Jupyter
Highlighted
Teradata Employee

Jupyter Extension makes Script Table Operators easy with Magics

Teradata SQL Extension for Jupyter provides magic commands to help users install and run Script Table Operators (STO). Teradata Script Table Operators can be used to execute Linux commands inside the database.  Moving the analytics to the data is a desirable feature for R and Python users who want the ability to process large amounts of data on the Teradata Database with scripts written in these external languages. In-database analytics can be particularly useful for R users, who otherwise need to export large volumes of data to compute clusters for their analytic processing requirements. 

 

Magic commands are built-in to the Teradata SQL Notebook to provide custom execution processing and simplify the user experience. The following commands are provided for STOs:

 

  • %pyinfo or %rinfo - Show information about the version of Python or R installed on the active Vantage database
  • %runsto – Run Script Table Operator provides options for running STOs.
  • %installfile, %showfile, %rmfile – install, show, and remove an STO file on the active Vantage connection

 

The best way to  demonstrate the Script Table Operators is to view the following series of snippets from a Teradata SQL Notebook.

The first animation shows initial magics to get started with Script Table Operators. 
JupyterSTOMagic-1.gif

 

Next, load and run an STO python script file and then view the loaded file.

 

JupyterSTOMagic-2.gif

 

Now that the STO has been installed, you can run the STO using the %runsto magic. 

JupyterSTOMagic-3.gif

 

Another option is to run the STO and insert the output into a table.

 

JupyterSTOMagic-4.gif 

Another feature that was added to the STO magics was the ability to show any errors that occurred when running the STO. Without this feature, it can be a difficult task to gather the error messages from the error logs on the amps.

The next snippet demonstrates an STO with an error and displaying the errors in the %runsto magic.

JupyterSTOMagic-5.gif

 

 

And finally, the Teradata SQL notebook includes magics to show, install, and remove STO files.

JupyterSTOMagic-6.gif

 

 

There is also a sample Script Table Operator Notebook (ScriptTableOperatorSample.ipynb) that you can download into your JupyterLab installation. NOTE: You must grant the user the appropriate privileges to install and run STOs.