Sprint: February 22 -- March 7

[RichardLitt]

Sprint February 22nd

Sprint Goals

Sprint Discussions

Schedule

Please take notes in a separate pad, if you can, and link it here.

Endeavour	Lead	Time (PDT - UTC/Z - CET)	Pad
sync	@RichardLitt	9:00pDT 17:00Z 18:00CET	IRC: #ipfs on Freenode
apps on ipfs	@dignifiedquire	10:30PDT 18:30Z 19:30CET	https://public.etherpad-mozilla.org/p/ipfs-feb-22-apps-on-ipfs
infrastructure	@lgierth	11:00PDT 19:00Z 20:00CET	https://public.etherpad-mozilla.org/p/ipfs-feb-22-infrastructure
libp2p	@diasdavid	11:30PDT 19:30Z 20:30CET	https://public.etherpad-mozilla.org/p/ipfs-feb-22-libp2p
js-ipfs	@diasdavid	12:00PDT 20:00Z 21:00CET	https://public.etherpad-mozilla.org/p/ipfs-feb-22-js-ipfs
go-ipfs	@whyrusleeping	12:30PDT 20:30Z 21:30CET	https://public.etherpad-mozilla.org/p/ipfs-feb-22-go-ipfs

Please add the Agenda to the Pad before the endeavour sprint starts.

Sprint Deliverables

• Add your tasks below in a comment, that way we only have people listed who are really in the sprint
• Add links to issues down here. Only add things you can finish this sprint.

[dignifiedquire]

Apps on IPFS

Lead: @dignifiedquire

Participants

• @dignifiedquire
• @jbenet
• @noffle
• @RichardLitt
• @diasdavid

Agenda

• Webui
  • Contributions
  • ipfs geoip
• Station
  • ARM
  • Stability
  • Tests
• Dignified Hacks

Notes

• Webui
  • Contributions
    • TODO(@dignifiedquire): Writing captainlog
    • Please ask questions if you have some
    • Updated [WIP] Implement Redux ipfs-webui#229 with more details about the work needed to be done
  • ipfs geoip
    • Nearly working, just missing pin on 0.3
• Station
  • ARM
    • Blocked on some electron-packager/electron issues for proper build
  • Stability
  • Tests
• Dignified Hacks
  • First episode of @dignifiedquire hacking on the webui this week

[RichardLitt]

To Do this week

• Sprint Management
• Write the weekly roundup
• Review all open PRs on http-api-spec
• Fill out RichardLitt/better-github-templates to answer PR and Issue templates community#108

[daviddias]

Libp2p

Lead: @diasdavid

Participants

Agenda & Notes

• status update
  • webrtc-explorer
  • libp2p builds for IPFS
• next steps
  • finish webrtc-explorer reboot - The Packet Switch Overlay Network over RTCDataChannels
  • libp2p-utp update to utp-native
  • libp2p-websockets for js and go (cause go doesn't have a good WebRTC implementation)
  • exo-transports spec - exo-tranports are external processes that offer transport implementations, this processes make an RPC API available through a unix socket or even other transport. This saves time and energy from developing every single transport in every language.

[hackergrrl]

@noffle sprint goals

• finish outstanding PRs + get them merged
  • handle N targets whyrusleeping/multireq#2
  • Prevents 'ipfs name publish' when /ipns is mounted. kubo#2323
  • Checks TEST_OS in a more POSIX-y manner. kubo#2368
  • Adds arbitrary port support to t0060-daemon.sh kubo#2370
• make go-ipfs compatible with 'go get' again
  • work /w lgierth to solve gateway unreliability
  • modify gx-go to publish a git repo that is dumb-http compatible
  • modify gx-go to rewrite urls to use ipfs.io
  • TEST: full publish workflow of a current go-ipfs dep that has no children
• integrate ipfs-dag improvements back into js-ipfs-merkle-dag
  • rename to ipfs-merkle-dag-node
    (as opposed to the ipld type, ipfs-ipld-node)
  • add my notes/thoughts to daviddias' internal API docs
  • split js-ipfs-merkle-dag into ipfs-merkle-dag-service (remove node impl)

[daviddias]

js-ipfs

Lead: @diasdavid

Participants

• @jbenet
• @RichardLitt
• @diasdavid
• Nathan

Agenda

• Status Update
• Next:
  • finish WIP: Make http-api endpoints as specified by the http-api-spec, for the features present in core  js-ipfs#69, which includes
    • http-api for every feature already implemented with tests and js-ipfs-api tests (for max interop)
    • make the cli use the http-api if the daemon is running
  • integrate libp2p-ipfs into js-ipfs to have swarm listen and connect
  • bitswap

[daviddias]

DAVID DIAS TODO

js-ipfs

• CR+M Add /api/v0/config endpoint js-ipfs#72
• CR+M Add /api/v0/config/show endpoint js-ipfs#74
• CR+M Add ipfs commands to cli js-ipfs#78
• CR+M Update to standard 6 js-ipfs#76
• CR+M Add ipfs config edit to cli js-ipfs#77
• WIP: Make http-api endpoints as specified by the http-api-spec, for the features present in core  js-ipfs#69
  • http-api: id (+ tests + js-ipfs-api tests)
  • replace globals by eslint-env mocha
  • http-api: bootstrap + tests
  • cli:id to use the daemon if on + tests
  • [~] chase http-api - get version test with js-ipfs-api fails **only** on Travis js-ipfs#70
• management
  • captain.log
  • update js-ipfs feature threads with new and refreshed action items
  • update roadmap update the roadmap js-ipfs#71
  • estimate time for completion of remaining components
• swarm
  • listen
  • connect
  • interop
• js-libp2p-ipfs
• js-ipfs-data-importing
  • CR added buffer importer ipfs-inactive/js-ipfs-unixfs-engine#6
• js-ipfs-unixfs
  • CR+M fix a minor typo in the Markdown code of Travis CI build testing status js-ipfs-unixfs#3
• js-peer-id
  • some cleanup came to fix a square bracket, ended up touch a bunch of other things :) libp2p/js-peer-id#6
• js-peer-info
  • upgrade libp2p/js-peer-info#5
  • new features: add and remove multiaddrs, avoid adding repeating, addSafe mode to avoid multiaddr explosion libp2p/js-peer-info#6
  • replace set of multiaddrs feature libp2p/js-peer-info#8

js-ipfs-api

• debug and fix ls and refs on js-ipfs-api for 0.4.0 ipfs-inactive/js-ipfs-http-client@a185c92
• CR+M Add symlink support to feat/files-api  ipfs-inactive/js-ipfs-http-client#224
• CR+M Auto set json and bool flags on config.set ipfs-inactive/js-ipfs-http-client#221

libp2p

• webrtc-explorer 2.0.0 alpha release
  • webrtc-explorer reboot daviddias/webrtc-explorer#10
  • http://blog.daviddias.me/2016/02/28/webrtc-explorer-2-0-0-alpha-release
• libp2p-utp use utp-native instead libp2p/js-libp2p-utp#2
• libp2p-websockets
• js-libp2p-swarm
  • migrate to mocha, istanbul, chai and standard 6 update swarm libp2p/js-libp2p-switch#19
  • js-libp2p-tcp
    • major update, now knows how to handle multiple listeners, understands multiaddr directly on the createListener and knows how to close them all. This breaks interface-transport, but what it means is that it needed to be improved anyway. multiple listeners, more tests, understand multiaddr on the listen function libp2p/js-libp2p-tcp#3
    • Multiaddr freshness libp2p/js-libp2p-tcp#4
• deprecated js-spdy-stream-muxer deprecation notice libp2p/js-spdy-stream-muxer#8 (use libp2p-spdy instead)
• 0.2.0 js-libp2p-spdy (completely new version) 0.2.0 libp2p/js-libp2p-spdy#2
• 0.3.0 interface-stream-muxer 0.3.0 libp2p/interface-stream-muxer#5
• use interface-stream-muxer tests directly on js-libp2p-spdy Use the interface-stream-muxer tests directly libp2p/js-libp2p-spdy#3
• 0.1.0 + 0.2.0 js-libp2p-multiplex done libp2p/js-libp2p-mplex#1

npm on ipfs

station

ipscend

js-ipfsd-ctl

specs

• R https://github.com/ipfs/http-api-spec/pull/51/files
• R Added Group config ipfs-inactive/http-api-spec#29
• R Added Group tar ipfs-inactive/http-api-spec#53
  extra
  • [ ](but essential) learn Go
  • make a contribution to go-ipfs - Feature: ipfs repo stat kubo#2430
  • write IPFS pinning bot nodes Expose common IPFS bot interface for IRC, Slack, Telegram, and CLI clients integration notes#113

[whyrusleeping]

@whyrusleeping sprint goals

• large big huge testing framework/tests
• pinning fix PR merged go-ipfs#2384
• build process improved
  • force gx to use 0.4.0 gateways
  • better docs around building from source
  • go compiler version checks
  • make gx handle cross compilations better
  • makefile should warn user if not building from within GOPATH
• try for zero random test failures on travis and circle

[nginnever]

@nginnever goals

- js-ipfs - [ ] command cat (meow) - js-ipfs-data-importing (js-ipfs issue #41) - [ ] streamImporter (more questions) - [~] BufferImporter (CR) - [ ] export function - [ ] browser / mocha tests - js-peer-id - [ ] create dist files - Webui - [ ] write some tests for new components - [ ] document in contibuting.md

[whyrusleeping]

go-ipfs

Lead: @whyrusleeping

Participants

• @jbenet
• @diasdavid
• @whyrusleeping
• @RichardLitt
• @noffle
• @dignifiedquire

Agenda

• CI is greener, needs to be even more greenerer
• Large Big Huge Test Things (tm)

Notes

• generate sequence of random actions
• build harness to run those generated actions, and halt on failure
• check results and integrity every so often

Asks

• fix some appveyor failures
• provide feedback on process of installing ipfs from source
• vendor packages in /thirdparty out with gx
  • ask @whyrusleeping for any help
  • any and all UX feedback here is appreciated

Infrastructure

Lead: @lgierth

Participants

• @RichardLitt
• @jbenet
• @dignifiedquire
• @whyrusleeping
• @diasdavid

Agenda

• a lot of requests for pinbot to work again. (also on 0.4)
• gateway issues
• moving away from docker, in part
• metrics
  • v03x
• dist.ipfs.io needs https

Notes

• pinning
  • goroutine explosion and thus bitswap contention, there's a PR by @whyrusleeping fixing it
  • pinbot and pinbot-v03x
  • there is a PR open for pinbot, which starts collecting a note for each !pin invocation
• geoip
  • merkledag and source data need pinning on both v03x and v04x
  • ipfs-station will use geoip merkledag, and ships go-ipfs 0.3.11
• ssl for *.ipfs.io
  • the current cert only covers ipfs.io and gateway.ipfs.io
  • i fucked up the identity verification for getting a wildcard
  • having another try now :)
• gateway issues
  • multireq was incorrectly passing on certain error responses, instead of trying the second network too
  • docker daemon sometimes crashes
  • docker sometimes loses track of container state
  • moving away from docker for now, will write down issues we had
  • next: runc and runit
• metrics
  • http://metrics.i.ipfs.io
    • set up cjdns, get peering (https://github.com/hyperboria/peers), and tell @lgierth your IPv6 address to add it to the VPN allowlist
  • v03x metrics are back and have their own dashboard
  • the current gateway/api HTTP metrics are from go-ipfs's point of view
  • we badly need nginx-level metrics, but the really useful stuff is part of their pay-per-instance subscription
  • we're going to parse nginx logs and make metrics from that
  • we'll have birds-eye view metrics of ipfs.io in a bit: https://github.com/whyrusleeping/ipfs-watcher

• infrastructure
  • handle gx in solarnet deployment
  • identity validation for *.ipfs.io cert taken over by @whyrusleeping
  • migrate from docker to runc+runit
  • write down docker issues
• pages / dnslink
  • comprehensible messaging in dnslink-deploy
  • make blog independent of website
  • use _dnslink and CNAME for blog: dig +short CNAME _dnslink.blog.ipfs.io
  • update ipfs.io, dist.ipfs.io, chat.ipfs.io
  • fix dns command docs dns: update dns command docs kubo#2438
• pinning
  • pin geoip on v04x
  • pin geoip on v03x blocked by pinning issues
  • fix pinbot
• metrics
  • bring back ipfs metrics on master
  • nginx metrics
  • multireq metrics
  • v03x/v04x uptime metrics
  • use proper rate() function for HTTP graphs
• fc00/cjdns
  • cryptoauth spec draft
  • switch spec draft
  • cjdns fixes dht: remove dead Node_setCost() cjdelisle/cjdns#910 dht: have getLinks() accept empty parent cjdelisle/cjdns#911 key: crypto has moved to golang.org/x fc00/go-cjdns#1
• reminder to self
  • github assignments: https://github.com/issues/assigned

[dignifiedquire]

• libp2p
  • karma-peer
    • Add dynamic browser launching
• ipfs-geoip
  • Pin all the data
  • Release 2.0.0
• webui
  • Use new ipfs-geoip for location data
  • Add polling to the peers page
  • Files browser
  • Write captain.log (Captain.log ipfs-webui#259)
  • Finish tests for peers caching
• dignified hacks
  • Base setup on beamp.pro
  • Decide on content for the first session: "Webui File Browser"
  • Schedule first session
  • Do first session
• go-ipfs
  • Big Bad Tests (TM)
    • Randor - Randomized testing prototype
    • Base structure
    • Add and pin commands
    • Better randomness generators
• PM
  • Discuss new sync format
  • Write update for weekly
• website
  • Ship new install instructions