# Online meeting: clojure data science

**URL:** https://clojureverse.org/t/online-meeting-clojure-data-science/3503
**Category:** Meetups and Events
**Created:** [January 16, 2019, 10:11pm UTC](https://clojureverse.org/t/online-meeting-clojure-data-science/3503 "2019-01-16T22:11:45Z")
**Posts on this page:** 20
**Page:** 4

<div class="post-metadata">

### Author: ![jsa-aerial](https://clojureverse.org/user_avatar/clojureverse.org/jsa-aerial/32/1790_2.png) [@jsa-aerial](https://clojureverse.org/u/jsa-aerial)
#### Post date: [January 22, 2019, 4:12am UTC](https://clojureverse.org/t/online-meeting-clojure-data-science/3503/62 "2019-01-22T04:12:00Z")

</div>

So, what does the actual rendering? Are you saying all of it is written in Clj with no C/Java/?? rendering engine???

---

<div class="post-metadata">

### Author: ![zcaudate](https://clojureverse.org/letter_avatar_proxy/v4/letter/z/2bfe46/32.png) [@zcaudate](https://clojureverse.org/u/zcaudate)
#### Post date: [January 22, 2019, 4:55am UTC](https://clojureverse.org/t/online-meeting-clojure-data-science/3503/63 "2019-01-22T04:55:01Z")

</div>

@jsa-aerial: thing is super impressive it’s pretty much built from the ground up with few dependencies. Visualisation and data science are very much intertwined and it would make a great native visualisation package. My main issue is that it’s developed using tangle/org mode and I have no idea how to contribute to the project.

---

<div class="post-metadata">

### Author: ![joinr](https://clojureverse.org/user_avatar/clojureverse.org/joinr/32/1861_2.png) [@joinr](https://clojureverse.org/u/joinr)
#### Post date: [January 22, 2019, 6:44am UTC](https://clojureverse.org/t/online-meeting-clojure-data-science/3503/64 "2019-01-22T06:44:53Z")

</div>

No longer true. Author switched to a normal repo last year on the [no org branch](https://github.com/thi-ng/geom/tree/feature/no-org/src/thi/ng/geom).

@jsa-aerial  
I’ve been using it as a supplement to quil with some deferred rendering stuff, although there’s both a minimal webgl backend and a java opengl backend (and some projected rendering to 2d svg). They’re more of the camera, lights, triangles and shaders minimalism, with working examples using the thi.ng libraries to compute the inputs in a higher level fashion. Lots of control though.

---

<div class="post-metadata">

### Author: ![joinr](https://clojureverse.org/user_avatar/clojureverse.org/joinr/32/1861_2.png) [@joinr](https://clojureverse.org/u/joinr)
#### Post date: [January 22, 2019, 6:55am UTC](https://clojureverse.org/t/online-meeting-clojure-data-science/3503/65 "2019-01-22T06:55:58Z")

</div>

Not a big fan of the DEVS formalism for my work. Evaluated simpy years back but dumped it in favor of custom solution (and some other external considerations). I remember seeing some ill advertised libs in scala and java (mostly from academia). I was pretty impressed with JaamSim (although it’s oop and heavy on mutation) talking to folks at WinterSim years back; they were aiming at competing with proprietary software while remaining open source. “Data Science” tends to generally ignore discrete event sim and optimization (bread and butter Ops Research fields) in my experience. They may remain niche/external, or poorly defined terms may end up encompassing both into “Data Science” at some point.

I intend to wrap my incanter fork around kixi.stats in the near future (no idea if upstream would dig that). Great library (also portable cljc).

---

<div class="post-metadata">

### Author: ![Neo](https://clojureverse.org/user_avatar/clojureverse.org/neo/32/1789_2.png) [@Neo](https://clojureverse.org/u/Neo)
#### Post date: [January 22, 2019, 8:06am UTC](https://clojureverse.org/t/online-meeting-clojure-data-science/3503/66 "2019-01-22T08:06:10Z")

</div>

So how is it going to develop? Are we creating a subsection of forums so that we can discuss for each part?

---

<div class="post-metadata">

### Author: ![whilo](https://clojureverse.org/user_avatar/clojureverse.org/whilo/32/1056_2.png) [@whilo](https://clojureverse.org/u/whilo)
#### Post date: [January 22, 2019, 8:11am UTC](https://clojureverse.org/t/online-meeting-clojure-data-science/3503/67 "2019-01-22T08:11:07Z")

</div>

I think the current master branch has moved away from org-mode(?). I have considered starting to use org-mode myself lately, but this is the reason why we opted against it. It is kind of the best literate programming environment though. Do you still have plans to evolve hydrox?

---

<div class="post-metadata">

### Author: ![whilo](https://clojureverse.org/user_avatar/clojureverse.org/whilo/32/1056_2.png) [@whilo](https://clojureverse.org/u/whilo)
#### Post date: [January 22, 2019, 8:12am UTC](https://clojureverse.org/t/online-meeting-clojure-data-science/3503/68 "2019-01-22T08:12:49Z")

</div>

Hey everybody!

Really nice to see all the shared interests here. I am maintaining Anglican and I am curious to hear people’s needs and interests. I am also in general working with Clojure in backend and frontend settings besides my research and think it is a nice fit. The recent Anglican version for example runs also in ClojureScript.

Best,  
Christian

---

<div class="post-metadata">

### Author: ![otfrom](https://clojureverse.org/user_avatar/clojureverse.org/otfrom/32/754_2.png) [@otfrom](https://clojureverse.org/u/otfrom)
#### Post date: [January 22, 2019, 8:59am UTC](https://clojureverse.org/t/online-meeting-clojure-data-science/3503/69 "2019-01-22T08:59:02Z")

</div>

thi.ng creates SVG or webgl itself.

---

<div class="post-metadata">

### Author: ![otfrom](https://clojureverse.org/user_avatar/clojureverse.org/otfrom/32/754_2.png) [@otfrom](https://clojureverse.org/u/otfrom)
#### Post date: [January 22, 2019, 9:01am UTC](https://clojureverse.org/t/online-meeting-clojure-data-science/3503/70 "2019-01-22T09:01:48Z")

</div>

As a user and sponsor of kixi.stats I’d be into that. I worry a bit about carrying on with incanter as it is just so big.

As a company we definitely do cohort component, DES and MCMC so we’d like to see more stuff there. Not everything is a neural network. 🙂 (I kid! I kid! pls don’t hit me actual data scientists!)

@joinr Do you think it is worth factoring out your DES stuff from spork into its own library?

---

<div class="post-metadata">

### Author: ![daslu](https://clojureverse.org/user_avatar/clojureverse.org/daslu/32/4173_2.png) [@daslu](https://clojureverse.org/u/daslu)
#### Post date: [January 22, 2019, 9:18am UTC](https://clojureverse.org/t/online-meeting-clojure-data-science/3503/71 "2019-01-22T09:18:49Z")

</div>

@Neo, re

> [@Neo](#):
>
> So how is it going to develop? Are we creating a subsection of forums so that we can discuss for each part?

There are several options to consider – let us discuss this under that separate topic:

> [@Online meeting: clojure data science -- discussing the format](https://v2.clojureverse.org/t/online-meeting-clojure-data-science-discussing-the-format/3643/2):
>
> OK, wrt ‘Discussion platform’, I’m convinced something other than clojureverse is needed. After being granted new status to make new comments/replies, I just hit yet another limitation: 'you cannot have more than 3 consecutive comments/replies". That’s probably fixable with some new status tweek, but then there probably even more limitations to be hit. Zulip may be the better option, though I’ve had issues with that as well.

---

<div class="post-metadata">

### Author: ![otfrom](https://clojureverse.org/user_avatar/clojureverse.org/otfrom/32/754_2.png) [@otfrom](https://clojureverse.org/u/otfrom)
#### Post date: [January 22, 2019, 10:03am UTC](https://clojureverse.org/t/online-meeting-clojure-data-science/3503/72 "2019-01-22T10:03:25Z")

</div>

@whilo I think I’d like to understand when I should be using Anglican and when I should be using other Bayesian and probabilistic tools. With all of these I think there are trade offs around speed or fitting in with particular frameworks or expressiveness that we need to think about. Knowing where each of our options fits would be great.

---

<div class="post-metadata">

### Author: ![zcaudate](https://clojureverse.org/letter_avatar_proxy/v4/letter/z/2bfe46/32.png) [@zcaudate](https://clojureverse.org/u/zcaudate)
#### Post date: [January 22, 2019, 10:47am UTC](https://clojureverse.org/t/online-meeting-clojure-data-science/3503/73 "2019-01-22T10:47:45Z")

</div>

hydrox has evolved (twice) though I’m using more of a repl based bulk namespace approach as opposed to a file-watch approach (I found it inconsistent and needed resetting once in a while). The current landscape for docs isn’t too bad with cljdocs.

Are there any crossovers between anglican and bayadera? it’d be really helpful to have some sort of a comparison matrix between not just the pp libraries but also the ml ones as well. I understand ‘conj’ and ‘assoc’ really well. It’d be great to have some of the more difficult concepts simplified, explained and compared.

---

<div class="post-metadata">

### Author: ![jackrusher](https://clojureverse.org/user_avatar/clojureverse.org/jackrusher/32/457_2.png) [@jackrusher](https://clojureverse.org/u/jackrusher)
#### Post date: [January 22, 2019, 11:28am UTC](https://clojureverse.org/t/online-meeting-clojure-data-science/3503/74 "2019-01-22T11:28:22Z")

</div>

I really like the API of `kixi.stats`, for what it’s worth.

I also love Karsten’s `thing` libraries and have long championed them to the clojure community, but would caution us to look carefully at the feature set of VEGA. `geom` is a great foundation that certainly _could_ serve this purpose, but we should be clear on how much work is involved to bring it to feature parity with VEGA.

---

<div class="post-metadata">

### Author: ![otfrom](https://clojureverse.org/user_avatar/clojureverse.org/otfrom/32/754_2.png) [@otfrom](https://clojureverse.org/u/otfrom)
#### Post date: [January 22, 2019, 11:43am UTC](https://clojureverse.org/t/online-meeting-clojure-data-science/3503/75 "2019-01-22T11:43:27Z")

</div>

Ah, the implementation of kixi.stats (api and guts) is all @henrygarner so he should get the kudos.

I agree that VEGA based things would be a very good place to concentrate our efforts, especially given the grammar of graphics and grammar of interaction that they’ve thought about and appears very successful.

If we want to spend a lot of time having fun we could make that grammar also work with thi.ng (which I’m a fan of as well). I don’t think we should be betting on thi.ng directly at the moment.

---

<div class="post-metadata">

### Author: ![daslu](https://clojureverse.org/user_avatar/clojureverse.org/daslu/32/4173_2.png) [@daslu](https://clojureverse.org/u/daslu)
#### Post date: [January 22, 2019, 12:13pm UTC](https://clojureverse.org/t/online-meeting-clojure-data-science/3503/76 "2019-01-22T12:13:04Z")

</div>

We continue the discussion with some better granularity at Zulip, under [the data-science stream](https://clojurians.zulipchat.com/#narrow/stream/151924-data-science).

For background on Zulip, see [this discussion](https://v2.clojureverse.org/t/introducing-clojurians-zulip/3173).

It is recommended to know a bit about Zulip’s concepts of [streams and topics](https://zulipchat.com/help/about-streams-and-topics#streams-and-topics).

See you there!

---

<div class="post-metadata">

### Author: ![joinr](https://clojureverse.org/user_avatar/clojureverse.org/joinr/32/1861_2.png) [@joinr](https://clojureverse.org/u/joinr)
#### Post date: [January 22, 2019, 8:14pm UTC](https://clojureverse.org/t/online-meeting-clojure-data-science/3503/77 "2019-01-22T20:14:24Z")

</div>

> Do you think it is worth factoring out your DES stuff from spork into its own library?

For various values of “worth” 🙂 spork is an intentionally accreted monolith, the bits of which are in various states of use (and active development). It’s definitely designed for modularity though, and I’ve looked at breaking out bits into separate libraries (but lack the external motivation) either manually or automatically. In practice, the DES stuff uses/exploits bits of the ecosystem, like an entity component system, behavior trees, and some minor stats libraries. In the mid-long run, I’d shift towards using something to extract the dependencies during publication. I also need to port some rudimentary examples (currently half baked). I’m more concerned with production than adoption at the moment though (although happy to answer questions).

Personally, I’m more interested in refactoring and applying fixes to Incanter since we continue to leverage it in internal processes. I got bogged down in refactoring the plotting implementation (all multimethods and macros, heavily tied to JFreeChart too, which involved munging through the JfreeChart docs). I’m looking hard at adding a vega backend with a compatible porcelain API from incanter.charts (rendering to browser/html, or javafx webview to eschew spinning up a server). Incanter is big, but it’s also modular (via lein-modules), so it’s manageable IMO.

---

<div class="post-metadata">

### Author: ![stardiviner](https://clojureverse.org/user_avatar/clojureverse.org/stardiviner/32/139_2.png) [@stardiviner](https://clojureverse.org/u/stardiviner)
#### Post date: [January 23, 2019, 12:27am UTC](https://clojureverse.org/t/online-meeting-clojure-data-science/3503/78 "2019-01-23T00:27:11Z")

</div>

I’m an Emacs Org Mode user, I usually do some simple statistics on Org Mode “Literate Programming”. I have an suggestion, might create an GitHub README/Wiki page for Clojure Data Science, add link to library, and add detailed description about library. Maybe add some Clojure Data Science useful knowledge there. So people can find information easily. Put all info in one place would help newbie find what they want. WDYT? Looking information around is diffcult for me.

---

<div class="post-metadata">

### Author: ![daslu](https://clojureverse.org/user_avatar/clojureverse.org/daslu/32/4173_2.png) [@daslu](https://clojureverse.org/u/daslu)
#### Post date: [January 23, 2019, 7:20am UTC](https://clojureverse.org/t/online-meeting-clojure-data-science/3503/79 "2019-01-23T07:20:38Z")

</div>

Thanks @stardiviner! Emacs Org Mode is beautiful.

That is a great idea, we are working on a website – will share in a few days to get some feedback.

---

<div class="post-metadata">

### Author: ![daslu](https://clojureverse.org/user_avatar/clojureverse.org/daslu/32/4173_2.png) [@daslu](https://clojureverse.org/u/daslu)
#### Post date: [January 23, 2019, 7:21am UTC](https://clojureverse.org/t/online-meeting-clojure-data-science/3503/80 "2019-01-23T07:21:13Z")

</div>

Hi!

We made this questionnaire to prepare for the Clojure data science online meeting.

> **[clj ds meeting -- some questions](https://docs.google.com/forms/d/e/1FAIpQLSedMO-3B8h1pOHDv2q088WdMH6yocGGnU1WiYLoCRsTC7rDKQ/viewform?usp=pp_url)**
>
> Hi! We wish to collect some info about the people who are willing to participate in the Clojure data science online meeting. 
> 
> Your response here will be extremely helpful!
> 
> Please note that no question is mandatory -- e.g., you do not have to say...

Your response here will be extremely helpful!

Please note that no question is mandatory – e.g., you do not have to say even your name.

Thanks!

---

<div class="post-metadata">

### Author: ![jackrusher](https://clojureverse.org/user_avatar/clojureverse.org/jackrusher/32/457_2.png) [@jackrusher](https://clojureverse.org/u/jackrusher)
#### Post date: [January 23, 2019, 3:45pm UTC](https://clojureverse.org/t/online-meeting-clojure-data-science/3503/81 "2019-01-23T15:45:15Z")

</div>

Well, my compliments to the chef 🙂

[Previous page](https://clojureverse.org/t/online-meeting-clojure-data-science/3503.md?page=3)

[Next page](https://clojureverse.org/t/online-meeting-clojure-data-science/3503.md?page=5)
