Mastodon
Mastodon 是一种联合社交媒体和社交网络服务。
此加载程序使用 Mastodon.py
Python 包从一组 Mastodon
帐户的“推文”中获取文本。
默认情况下,可以查询公共帐户,无需任何身份验证。如果查询非公开帐户或实例,则必须为您的帐户注册一个应用程序,该应用程序会为您提供访问令牌,并设置该令牌和您帐户的 API 基本 URL。
然后,您需要以 @account@instance
格式传入您想要提取的 Mastodon 帐户名称。
from langchain_community.document_loaders import MastodonTootsLoader
API 参考:MastodonTootsLoader
%pip install --upgrade --quiet Mastodon.py
loader = MastodonTootsLoader(
mastodon_accounts=["@[email protected]"],
number_toots=50, # Default value is 100
)
# Or set up access information to use a Mastodon app.
# Note that the access token can either be passed into
# constructor or you can set the environment "MASTODON_ACCESS_TOKEN".
# loader = MastodonTootsLoader(
# access_token="<ACCESS TOKEN OF MASTODON APP>",
# api_base_url="<API BASE URL OF MASTODON APP INSTANCE>",
# mastodon_accounts=["@[email protected]"],
# number_toots=50, # Default value is 100
# )
documents = loader.load()
for doc in documents[:3]:
print(doc.page_content)
print("=" * 80)
<p>It is tough to leave this behind and go back to reality. And some people live here! I’m sure there are downsides but it sounds pretty good to me right now.</p>
================================================================================
<p>I wish we could stay here a little longer, but it is time to go home 🥲</p>
================================================================================
<p>Last day of the honeymoon. And it’s <a href="https://mastodon.social/tags/caturday" class="mention hashtag" rel="tag">#<span>caturday</span></a>! This cute tabby came to the restaurant to beg for food and got some chicken.</p>
================================================================================
默认情况下,推文文本(文档的 page_content
)是 Mastodon API 返回的 HTML。