Things I Learned: Querying Datasette using URLs

I never expected the Rockmite ham radio to get anywhere close to working all 50 states. Consequently, the QSO database for the rig doesn't include state or county columns. Diaze—my12 year-old partner in crime—and I set out to fill in the missing data this weekend while she learned to program Python. I'll discuss the complete project soon. While we were working, I learned that I could query Datasette via URL.

My SQL is a bit rusty. That pushed me towards controlling Datasette from the outside, and frankly, that made more sense and was more on theme for learning about sending URL requests and using the returned json text—a topic Diaze is working on learning this week. It was also a more complete solution that didn't require moving data from a web page into a Python script.

I noticed that when I ran a Python query, and then pressed the link for either CSV or json output, the URL of the output reflected the original query. Here's the query for outputting all QSOs from the database:

http://127.0.0.1:8001/rm_toucans_23_10_07.json?sql=select+Spotter%2C+rx_lng%2C+rx_lat+from+rm_rnb_history_pres+where+%22dB%22+%3E+%3Ap0+order+by+rowid&p0=99

It seemed simple enough to use Python requests to feed the results from a query of one database—QSOs—as parameters for a query to another database—the Datasette counties example database. And I did exactly that. The URLs are long due to URL escaping, so I won't include them here, but you can see them in the github repo.

The thing I learned is that by rewriting the URL in a loop I could add the latitude and longitude for each QSO—something we did store in the original database—and retrieve the state and county for each call. Here's the tail-end of the modified counties URL:

&longitude='+str(lng)+'&latitude='+str(lat))

The query results are returned in the "rows" member of a json object

for localities in z["rows"]:

And here is what the results look like for now:

The next step will be to add them to an edited version of the database—within the script of course—rm_rnb_history_pres.csv.

Comments

Cool Math Tricks: Deriving the Divergence, (Del or Nabla) into New (Cylindrical) Coordinate Systems

Now available as a Kindle ebook for 99 cents ! Get a spiffy ebook, and fund more physics The following is a pretty lengthy procedure, but converting the divergence, (nabla, del) operator between coordinate systems comes up pretty often. While there are tables for converting between common coordinate systems , there seem to be fewer explanations of the procedure for deriving the conversion, so here goes! What do we actually want? To convert the Cartesian nabla to the nabla for another coordinate system, say… cylindrical coordinates. What we’ll need: 1. The Cartesian Nabla: 2. A set of equations relating the Cartesian coordinates to cylindrical coordinates: 3. A set of equations relating the Cartesian basis vectors to the basis vectors of the new coordinate system: How to do it: Use the chain rule for differentiation to convert the derivatives with respect to the Cartesian variables to derivatives with respect to the cylindrical variables. The chain ...

The Alcubierre Warp Drive Tophat Function and Open Science with Sage

I transferred yesterday's Mathematica file with the Alcubierre warp drive[2] line element and space curvature calculations to the +Sage Mathematical Software System today, (the files been added to the public repository [3]). If you haven't used Sage before, it's a Python based software package that's similar in functionality to Mathematica. Oh, and it' free. I also worked a little more on understanding the theory, but frankly, I made far more progress with the software than the theory. What follows will be a little more of the Alcubierre theory, plus, a cool Sage interactive demo of one of the Alcubierre functions[1], as well as a bit about my first experience with using Sage. Theory The theory is fun, but it's moving slowly. Here's the chalk board from this morning's discussion Alcubierre setup the derivation using something called the 3+1 formalism which means we consider space to be flat, (in this case), slices that are labelled ...

The Valentine's Day Magnetic Monopole

There's an assymetry to the form of the two Maxwell's equations shown in picture 1. While the divergence of the electric field is proportional to the electric charge density at a given point, the divergence of the magnetic field is equal to zero. This is typically explained in the following way. While we know that electrons, the fundamental electric charge carriers exist, evidence seems to indicate that magnetic monopoles, the particles that would carry magnetic 'charge', either don't exist, or, the energies required to create them are so high that they are exceedingly rare. That doesn't stop us from looking for them though! Keeping with the theme of Fairbank[1] and his academic progeny over the semester break, today's post is about the discovery of a magnetic monopole candidate event by one of the Fairbank's graduate students, Blas Cabrera[2]. Cabrera was utilizing a loop type of magnetic monopole detector. Its operation is in...

Copasetic Flow

Search This Blog