A simple script to show Airflow 1.10.9 tasks states in non-GUI environments
TL;DR Suppose you have an Airflow 1.10.9 (this is important) instance running with REST API enabl...
0
0
Comment0
17 search resultsShowing 1~17 results
Stocked
You need to log-in
A simple function for getting BigQuery quota usage per project
TL;DR In order to check how many mebibytes of quota you have used and have many have in total for...
0
0
Comment0
Using Docker-outside-of-Docker and Flask to use easily Docker inside the containers
Disclaimer Note that the approach presented in this article is only meant to be used within a tru...
1
0
Comment0
Simple Docker image to convert Japanese Jupyter Notebook to PDF
TL;DR If you want to convert Jupyter Notebook (possibly, with Japanese script included) to pdf, d...
0
1
Comment0
Visualising intersection-over-union relationship via Venn Diagrams
In my work, I sometimes have to explain how certain datasets changed over time. For example, rece...
0
0
Comment0
Column order changes results of XGBoost model prediction
In this short note I would like to share something I have myself learned only recently. Although ...
0
0
Comment0
Simple function to export and download XGBoost BigQuery model
Today I would like briefly share with you a simple function I have assembled in order to export a...
3
0
Comment0
Displaying progress bar and ETA for Airflow backfills
During my work I often have to run long Airflow backfills. They take very long time and my boss o...
0
0
Comment0
Formula for gradient of correlation function (with applications)
While in general in Machine Learning the optimization with respect to L1 or L2 or some other norm...
0
0
Comment0
Uploading Pandas Dataframes to Google Sheets
Intro and Motivation Recently during my work I often find myself in need of reading/writing to Go...
2
0
Comment0
Computing the BigQuery cost of a single Airflow DAG run
TL;DR To estimate the number of bytes processed by a single run of a given DAG on a given day, ex...
0
0
Comment0
Solving the problem of finding equivalent resistance with Python
The problem This article was inspired by my sister's question. Some time ago she asked me to chec...
0
0
Comment2
Smallest circle problem on $\mathbb{S}^2$
Original problem Smallest circle problem is a well-known problem in planar geometry, which consis...
0
0
Comment0
Extendable skeletons for Vim using Python, Click and Jinja2
Problem statement As a member of the software team at Datawise, Inc., I want my part of code to b...
0
0
Comment0
Computing average life expectancy of a line of code
Motivation Some time ago when I asked one of my colleagues, what whas his main motivation for bec...
0
0
Comment0
Extending Airflow's BigQueryOperator so to allow double substitution of parameters
This note describes the solution to a small problem related to Airflow's BigQueryOperator which I...
0
0
Comment0
Using Kepler.GL in Jupyter
In this note I would like to briefly introduce the possibility of using Kepler.GL in Jupyter note...
2
2
Comment0
17 search resultsShowing 1~17 results
Qiita is a knowledge sharing service for engineers.
- You can follow users and tags
- You can stock useful information
- You can make edit suggestions for articles