Package: pysparklyr 0.1.5.9001
Edgar Ruiz
pysparklyr: Provides a 'PySpark' Back-End for the 'sparklyr' Package
It enables 'sparklyr' to integrate with 'Spark Connect', and 'Databricks Connect' by providing a wrapper over the 'PySpark' 'python' library.
Authors:
pysparklyr_0.1.5.9001.tar.gz
pysparklyr_0.1.5.9001.zip(r-4.5)pysparklyr_0.1.5.9001.zip(r-4.4)pysparklyr_0.1.5.9001.zip(r-4.3)
pysparklyr_0.1.5.9001.tgz(r-4.4-any)pysparklyr_0.1.5.9001.tgz(r-4.3-any)
pysparklyr_0.1.5.9001.tar.gz(r-4.5-noble)pysparklyr_0.1.5.9001.tar.gz(r-4.4-noble)
pysparklyr_0.1.5.9001.tgz(r-4.4-emscripten)pysparklyr_0.1.5.9001.tgz(r-4.3-emscripten)
pysparklyr.pdf |pysparklyr.html✨
pysparklyr/json (API)
NEWS
| # Install 'pysparklyr' in R: |
| install.packages('pysparklyr', repos = c('https://mlverse.r-universe.dev', 'https://cloud.r-project.org')) |
Bug tracker:https://github.com/mlverse/pysparklyr/issues
databrickspysparksparkspark-connect
Last updated 15 hours agofrom:aa1b3be1ed. Checks:OK: 7. Indexed: yes.
| Target | Result | Date |
|---|---|---|
| Doc / Vignettes | OK | Sep 17 2024 |
| R-4.5-win | OK | Sep 17 2024 |
| R-4.5-linux | OK | Sep 17 2024 |
| R-4.4-win | OK | Sep 17 2024 |
| R-4.4-mac | OK | Sep 17 2024 |
| R-4.3-win | OK | Sep 17 2024 |
| R-4.3-mac | OK | Sep 17 2024 |
Exports:%>%connection_databricks_shinyappdeploy_databricksinstall_databricksinstall_pysparkinstalled_componentsml_prepare_datasetrequirements_writespark_connect_service_startspark_connect_service_stop
Dependencies:arrowaskpassassertthatbase64encbitbit64blobclicodetoolsconfigcpp11curlDBIdbplyrdigestdplyrfansifsgenericsglobalsglueherehttrhttr2jsonlitelatticelifecyclemagrittrMatrixmimeopensslpackratpillarpkgconfigPKIpngprocessxpspurrrR6rappdirsRcppRcppTOMLrenvreticulaterlangrprojrootrsconnectrstudioapisparklyrstringistringrsystibbletidyrtidyselectutf8uuidvctrswithrxml2yaml
Readme and manuals
Help Manual
| Help page | Topics |
|---|---|
| Deploys Databricks backed content to publishing server | deploy_databricks |
| Installs PySpark and Python dependencies | install_databricks install_pyspark |
| Lists installed Python libraries | installed_components |
| Creates the 'label' and 'features' columns | ml_prepare_dataset |
| Writes the 'requirements.txt' file, containing the needed Python libraries | requirements_write |
| Starts and stops Spark Connect locally | spark_connect_service_start spark_connect_service_stop |
