custom-xeps/xep-xxxx-extensible-file-thumbnails.md

127 lines
5.3 KiB
Markdown
Raw Permalink Normal View History

2022-06-30 10:07:01 +00:00
# Extensible File Thumbnails
2022-02-27 14:32:06 +00:00
## Introduction
When sending media, it is often helpful for users when a thumbnail can be shown before the
actual file is finished downloading.
XMPP already has a protocol for specifying thumbails, [Jingle Content Thumbnails](https://xmpp.org/extensions/xep-0264.html).
However, this protocol requires that the thumbnail is a base64-encoded image published using
[Bits of Binary](https://xmpp.org/extensions/xep-0231.html). This prevents clients from implementing newer technologies, such as
[Blurhash](https://github.com/woltapp/blurhash).
2022-06-30 10:07:01 +00:00
This document specifies are more general and extensible element for specifiying thumbnails in various formats.
2022-02-27 14:32:06 +00:00
## Usage
2022-02-27 17:40:32 +00:00
```xml
2022-08-25 12:44:13 +00:00
<file-thumbnail type="proto:urn:xmpp:eft:0:blurhash" xmlns="proto:urn:xmpp:eft:0">
2022-08-25 12:47:51 +00:00
<blurhash>LEHV6nWB2yk8pyoJadR*.7kCMdnj</blurhash>
2022-08-25 12:44:13 +00:00
</file-thumbnail>
2022-02-27 14:32:06 +00:00
```
2022-08-25 12:44:13 +00:00
This example specifies a thumbnail of type `blurhash`, meaning that the child element of the
`<file-thumbnail/>` element must contain a `<blurhash/>` element (See "Thumbnail Types").
2022-02-27 14:32:06 +00:00
2022-08-25 12:47:51 +00:00
A `<file-thumbnail/>` element MUST only contain one child; that is the child that is specified
by the `<file-thumbnail/>` type attribute.
2022-02-27 14:32:06 +00:00
### Thumbnail Types
#### Blurhash
2022-08-25 12:44:13 +00:00
If a sender specifies the type of the `<file-thumbnail/>` element to be
`proto:urn:xmpp:eft:0:blurhash`, then the `<blurhash/>` element's value must be interpreted
as [Blurhash](https://github.com/woltapp/blurhash) data. As a sender, care must be taken to
not make the Blurhash thumbnail too big as to not loose the advantages of Blurhash.
2022-02-27 14:32:06 +00:00
```xml
2022-08-25 12:44:13 +00:00
<file-thumbail xmlns="proto:urn:xmpp:eft:0">
2022-08-25 12:47:51 +00:00
<blurhash>LEHV6nWB2yk8pyoJadR*.7kCMdnj</blurhash>
2022-08-25 12:44:13 +00:00
</file-thumbnail>
```
2022-02-27 18:00:25 +00:00
#### Jingle Content Thumbnail Compatability
2022-06-30 10:07:01 +00:00
In order to enable a pseudo-interoperability with [Jingle Content Thumbnails](https://xmpp.org/extensions/xep-0264.html), inclusion of a
`<thumbnail/>` element is allowed. This is to allow easy reuse of an already existent [Jingle Content Thumbnails](https://xmpp.org/extensions/xep-0264.html)
2022-08-25 12:44:13 +00:00
implementation. The type of the `<file-thumbnail/>` must then be set to `proto:urn:xmpp:eft:0:base64-bob`.
```xml
2022-08-25 12:44:13 +00:00
<file-thumbail xmlns="proto:urn:xmpp:eft:0" type="proto:urn:xmpp:eft:0:base64-bob">
2022-06-30 10:07:01 +00:00
<thumbnail xmlns="urn:xmpp:thumbs:1" uri="cid:sha1+...@bob.xmpp.org" media-type="image/png" width="128" height="96" />
2022-08-25 12:44:13 +00:00
</file-thumbnail>
```
## Usage Example with Stateless Inline Media Sharing
2022-02-27 14:32:06 +00:00
NOTE: This example is taken from [Stateless Inline Media Sharing](https://xmpp.org/extensions/xep-0385.html) and modified for this protocol.
2022-02-27 17:40:32 +00:00
```xml
2022-02-27 14:32:06 +00:00
<message to='julient@shakespeare.lit' from='romeo@montague.lit'>
2022-08-25 12:44:13 +00:00
<body>Look at the nice view from the summit.</body>
<reference xmlns='urn:xmpp:reference:0' begin='17' end='20' type='data'>
<media-sharing xmlns='urn:xmpp:sims:1'>
<file xmlns='urn:xmpp:jingle:apps:file-transfer:5'>
<media-type>image/jpeg</media-type>
<name>summit.jpg</name>
<size>3032449</size>
<hash xmlns='urn:xmpp:hashes:2' algo='sha3-256'>2XarmwTlNxDAMkvymloX3S5+VbylNrJt/l5QyPa+YoU=</hash>
<hash xmlns='urn:xmpp:hashes:2' algo='id-blake2b256'>2AfMGH8O7UNPTvUVAM9aK13mpCY=</hash>
<desc>Photo from the summit.</desc>
<file-thumbnail type="base64-bob" xmlns='urn:xmpp:thumbnail:0'>
<base64-bob uri="cid:sha1+ffd7c8d28e9c5e82afea41f97108c6b4@bob.xmpp.org" media-type="image/png" width="128" height="96" />
</thumbnail>
<file-thumbnail type="proto:urn:xmpp:eft:0:blurhash" xmlns="proto:urn:xmpp:eft:0">
2022-08-25 12:47:51 +00:00
<blurhash>LEHV6nWB2yk8pyoJadR*.7kCMdnj</blurhash>
2022-08-25 12:44:13 +00:00
</file-thumbnail>
<file-thumbnail type="proto:urn:xmpp:eft:0:base64-bob" xmlns="proto:urn:xmpp:eft:0">
<thumbnail xmlns='urn:xmpp:thumbs:1'
uri='cid:sha1+ffd7c8d28e9c5e82afea41f97108c6b4@bob.xmpp.org'
media-type='image/png'
width='128'
height='96'/>
</file-thumbnail>
</file>
<sources>
<reference xmlns='urn:xmpp:reference:0' type='data' uri='https://download.montague.lit/4a771ac1-f0b2-4a4a-9700-f2a26fa2bb67/summit.jpg' />
<reference xmlns='urn:xmpp:reference:0' type='data' uri='xmpp:romeo@montague.lit/resource?jingle;id=9559976B-3FBF-4E7E-B457-2DAA225972BB' />
</sources>
</media-sharing>
</reference>
2022-02-27 14:32:06 +00:00
</message>
```
## Security Considerations
The same considerations apply as specified by [Jingle Content Thumbnails](https://xmpp.org/extensions/xep-0264.html).
2022-06-30 10:07:01 +00:00
## Todo
2022-06-30 10:11:51 +00:00
- Change XML namespace from `proto:urn:xmpp:eft:0` to `urn:xmpp:eft:0` once we submit this as an XEP
2022-06-30 10:07:01 +00:00
## Changelog
2022-08-25 12:47:51 +00:00
### 0.2.1
- Remove namespacing of the `<file-thumbnail/>`'s child element
2022-08-25 12:44:13 +00:00
### 0.2.0
- Namespace the thumbnail type
- `<file-thumbnails/>` to `<file-thumbnail/>`
2022-06-30 10:07:01 +00:00
### 0.1.0
- Remove the base64 thumbnail type
- Namespace all thumbnail types
2022-06-30 10:11:51 +00:00
- Remove the type attribute of `<file-thumbnail/>`
- Rename `<file-thumbnail/>` to `<file-thumbnails/>`
2022-06-30 10:07:01 +00:00
- Rename the namespace from file-thumbnails to eft
- Rename from File Thumbnails to Extensible File Thumbnails
## Info
| Key | Value |
| --- | --- |
| Author | PapaTutuWawa |
2022-08-25 12:47:51 +00:00
| Version | 0.2.1 |
2022-06-30 10:07:01 +00:00
| Short name | eft |