Skip to content

Replicates messages of accessible slack channels to Google BigQuery, after sentiment analysis enrichment

Notifications You must be signed in to change notification settings

mboogerd/slack-scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

37 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

README

This is a basic Slack scraper, built as a so-called "integrated API". This essentially means that the client is using a token-based instead of OAuth implementation for authentication.

Functionality

  • Retrieve all channels from a Slack space
  • Retrieve full message history from each channel
  • History retrieval is parallellized per channel
  • History retrieval is implemented as a sequence of calls over a cursor
  • Aggregate interesting elements per channel and participant
  • Queries are rate limited

TODO

  • Obtain user info for channel creators and for all users posting messages

Configuration

Create a go file for configuration, say 'config.go' and set the following two constants

const (
    // Obtain a token from https://api.slack.com/custom-integrations/legacy-tokens
    token = "xoxp-some-user-token-here"
    SlackApi = "https://yourspace.slack.com/api/"
)

Running

go run *.go

About

Replicates messages of accessible slack channels to Google BigQuery, after sentiment analysis enrichment

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages