I am exploring data bricks and writing all code in azure databricks notebooks.I read about IDEs such as data connect, vscode, pycharm, intell j. In real time people use IDEs or most of time people use data bricks notebooks. Please advise.
Regards,
CodePudding user response:
If you are experienced on any IDE like Eclipse, IntelliJ, PyCharm, RStudio, Visual Studio Code, Databricks Connect allows you to connect with these IDEs to feel comfortable during development. Otherwise, you can simply use Notebook.
This official document on Databricks Connect will help you to understand how Databricks Connect works. Steps given to start writing your notebook in any supported IDE. Also, you will be come to know the differences between running using Databricks Connect versus running in a Databricks notebook.
CodePudding user response:
You mentioned VSC (Visual studio code) and PyCharm. A few words from me:
- PyCharm has a paid version - premium, VSC is free.
- PyCharm has great support from JetBrains and VSC from Microsoft and the community.
- If you are a Python user, PyCHarm is probably a better choice.
- Two IDEs, i.e. PyCHarm and VSC, support Notebooks.
As for the official documentation, you will find there connection methods under the IDE. First I would start by looking at the one on the Databricks page:
Here's an article on Medium how you can connect Databricks to Pycharm:
Finally, you have Microsoft's documentation and shown how to make the connection:
Go through the tutorials and decide which IDE is most friendly to you.