Qwen3-VL-Embedding-2B model trained on Korean Visual Document Retrieval query-document screenshot pairs

This is a sentence-transformers model finetuned from Qwen/Qwen3-VL-Embedding-2B. It maps sentences & paragraphs to a 2048-dimensional dense vector space and can be used for retrieval.

Model Details

Model Description

  • Model Type: Sentence Transformer
  • Base model: Qwen/Qwen3-VL-Embedding-2B
  • Maximum Sequence Length: 262144 tokens
  • Output Dimensionality: 2048 dimensions
  • Similarity Function: Cosine Similarity
  • Supported Modalities: Text, Image, Video, Message
  • Language: ko
  • License: apache-2.0

Model Sources

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'transformer_task': 'feature-extraction', 'modality_config': {'text': {'method': 'forward', 'method_output_name': 'last_hidden_state'}, 'image': {'method': 'forward', 'method_output_name': 'last_hidden_state'}, 'video': {'method': 'forward', 'method_output_name': 'last_hidden_state'}, 'message': {'method': 'forward', 'method_output_name': 'last_hidden_state', 'format': 'structured'}}, 'module_output_name': 'token_embeddings', 'processing_kwargs': {'chat_template': {'add_generation_prompt': True}}, 'unpad_inputs': False, 'architecture': 'Qwen3VLModel'})
  (1): Pooling({'embedding_dimension': 2048, 'pooling_mode': 'lasttoken', 'include_prompt': True})
  (2): Normalize({})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
queries = [
    '30인 이상 상용근로자를 보유한 기업의 1인당 평균 월별 법정외 복지비용이 10~29인 규모 기업보다 높은지 판단해 주세요.',
]
documents = [
    'data/images/ko/ko-vdr-public/3818.png',
    'data/images/ko/ko-vdr-public/3950.png',
    'data/images/ko/ko-vdr-public/6891.png',
]
query_embeddings = model.encode_query(queries)
document_embeddings = model.encode_document(documents)
print(query_embeddings.shape, document_embeddings.shape)
# [1, 2048] [3, 2048]

# Get the similarity scores for the embeddings
similarities = model.similarity(query_embeddings, document_embeddings)
print(similarities)
# tensor([[ 0.5044, -0.0077,  0.1005]])

Evaluation

Metrics

Information Retrieval

  • Datasets: kovidore-v2-cybersecurity-beir-eval, kovidore-v2-hr-beir-eval, kovidore-v2-energy-beir-eval and kovidore-v2-economic-beir-eval
  • Evaluated with InformationRetrievalEvaluator with these parameters:
    {
        "query_prompt": "Find a screenshot that is relevant to the user's question."
    }
    
Metric kovidore-v2-cybersecurity-beir-eval kovidore-v2-hr-beir-eval kovidore-v2-energy-beir-eval kovidore-v2-economic-beir-eval
cosine_accuracy@1 0.7181 0.4434 0.6647 0.2515
cosine_accuracy@3 0.8993 0.6787 0.8613 0.4294
cosine_accuracy@5 0.9195 0.7828 0.9075 0.5215
cosine_accuracy@10 0.9597 0.8824 0.9249 0.6503
cosine_precision@1 0.7181 0.4434 0.6647 0.2515
cosine_precision@3 0.4698 0.3243 0.4663 0.1575
cosine_precision@5 0.3436 0.2597 0.3422 0.119
cosine_precision@10 0.2067 0.1828 0.2075 0.0791
cosine_recall@1 0.344 0.1471 0.2575 0.105
cosine_recall@3 0.6076 0.3176 0.5152 0.2027
cosine_recall@5 0.7006 0.4189 0.6092 0.2594
cosine_recall@10 0.81 0.577 0.7181 0.347
cosine_ndcg@5 0.6774 0.4071 0.604 0.2378
cosine_ndcg@10 0.7272 0.4755 0.6541 0.2726
cosine_mrr@10 0.8084 0.5864 0.7681 0.3681
cosine_map@100 0.6519 0.3883 0.5807 0.2154

Training Details

Training Dataset

Unnamed Dataset

  • Size: 708,729 training samples
  • Columns: anchor, positive, negative_1, negative_2, negative_3, negative_4, negative_5, negative_6, and negative_7
  • Approximate statistics based on the first 1000 samples:
    anchor positive negative_1 negative_2 negative_3 negative_4 negative_5 negative_6 negative_7
    type string string string string string string string string string
    details
    • min: 36 tokens
    • mean: 66.87 tokens
    • max: 118 tokens
    • min: 1240 tokens
    • mean: 1272.48 tokens
    • max: 1298 tokens
    • min: 1240 tokens
    • mean: 1272.4 tokens
    • max: 1298 tokens
    • min: 1240 tokens
    • mean: 1272.51 tokens
    • max: 1298 tokens
    • min: 1240 tokens
    • mean: 1272.28 tokens
    • max: 1298 tokens
    • min: 1240 tokens
    • mean: 1272.3 tokens
    • max: 1298 tokens
    • min: 1240 tokens
    • mean: 1272.69 tokens
    • max: 1298 tokens
    • min: 1240 tokens
    • mean: 1272.49 tokens
    • max: 1298 tokens
    • min: 1240 tokens
    • mean: 1272.36 tokens
    • max: 1298 tokens
  • Samples:
    anchor positive negative_1 negative_2 negative_3 negative_4 negative_5 negative_6 negative_7
    30인 이상 상용근로자를 보유한 기업의 1인당 평균 월별 법정외 복지비용이 10~29인 규모 기업보다 높은지 판단해 주세요. data/images/ko/ko-vdr-public/3818.png data/images/ko/ko-vdr-public/3763.png data/images/ko/ko-vdr-public/7798.png data/images/ko/ko-vdr-public/3752.png data/images/ko/ko-vdr-public/3770.png data/images/ko/ko-vdr-public/3773.png data/images/ko/ko-vdr-public/7805.png data/images/ko/ko-vdr-public/3785.png
    CAP 기반 조정이 Jensen‑Shannon 발산을 활용한 분포 유사성 검증에 어떤 영향을 미치는가? data/images/ko/ko-vdr-public/3950.png data/images/ko/ko-vdr-public/3934.png data/images/ko/ko-vdr-public/5252.png data/images/ko/ko-vdr-public/3959.png data/images/ko/ko-vdr-public/5096.png data/images/ko/ko-vdr-public/3960.png data/images/ko/ko-vdr-public/5196.png data/images/ko/ko-vdr-public/891.png
    소상공인 음식점업 체감경기 회복세가 온라인 음식서비스 성장률 확대와 소매판매액 내 비내구재 성장세 강화에 기여했는가? data/images/ko/ko-vdr-public/6891.png data/images/ko/ko-vdr-public/6886.png data/images/ko/ko-vdr-public/6919.png data/images/ko/ko-vdr-public/6883.png data/images/ko/ko-vdr-public/6948.png data/images/ko/ko-vdr-public/6882.png data/images/ko/ko-vdr-public/6915.png data/images/ko/ko-vdr-public/6921.png
  • Loss: MatryoshkaLoss with these parameters:
    {
        "loss": "CachedMultipleNegativesRankingLoss",
        "matryoshka_dims": [
            2048,
            1024,
            768,
            512,
            256,
            128
        ],
        "matryoshka_weights": [
            1,
            1,
            1,
            1,
            1,
            1
        ],
        "n_dims_per_step": -1
    }
    

Training Hyperparameters

Non-Default Hyperparameters

  • per_device_train_batch_size: 128
  • num_train_epochs: 1.0
  • learning_rate: 2e-05
  • lr_scheduler_type: cosine
  • warmup_steps: 0.1
  • gradient_accumulation_steps: 2
  • bf16: True
  • per_device_eval_batch_size: 128
  • eval_on_start: True
  • ddp_find_unused_parameters: True
  • batch_sampler: no_duplicates_hashed

All Hyperparameters

Click to expand
  • per_device_train_batch_size: 128
  • num_train_epochs: 1.0
  • max_steps: -1
  • learning_rate: 2e-05
  • lr_scheduler_type: cosine
  • lr_scheduler_kwargs: None
  • warmup_steps: 0.1
  • optim: adamw_torch_fused
  • optim_args: None
  • weight_decay: 0.0
  • adam_beta1: 0.9
  • adam_beta2: 0.999
  • adam_epsilon: 1e-08
  • optim_target_modules: None
  • gradient_accumulation_steps: 2
  • average_tokens_across_devices: True
  • max_grad_norm: 1.0
  • label_smoothing_factor: 0.0
  • bf16: True
  • fp16: False
  • bf16_full_eval: False
  • fp16_full_eval: False
  • tf32: None
  • gradient_checkpointing: False
  • gradient_checkpointing_kwargs: None
  • torch_compile: False
  • torch_compile_backend: None
  • torch_compile_mode: None
  • use_liger_kernel: False
  • liger_kernel_config: None
  • use_cache: False
  • neftune_noise_alpha: None
  • torch_empty_cache_steps: None
  • auto_find_batch_size: False
  • log_on_each_node: True
  • logging_nan_inf_filter: True
  • include_num_input_tokens_seen: no
  • log_level: passive
  • log_level_replica: warning
  • disable_tqdm: False
  • project: huggingface
  • trackio_space_id: trackio
  • per_device_eval_batch_size: 128
  • prediction_loss_only: True
  • eval_on_start: True
  • eval_do_concat_batches: True
  • eval_use_gather_object: False
  • eval_accumulation_steps: None
  • include_for_metrics: []
  • batch_eval_metrics: False
  • save_only_model: False
  • save_on_each_node: False
  • enable_jit_checkpoint: False
  • push_to_hub: False
  • hub_private_repo: None
  • hub_model_id: None
  • hub_strategy: every_save
  • hub_always_push: False
  • hub_revision: None
  • load_best_model_at_end: False
  • ignore_data_skip: False
  • restore_callback_states_from_checkpoint: False
  • full_determinism: False
  • seed: 42
  • data_seed: None
  • use_cpu: False
  • accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
  • parallelism_config: None
  • dataloader_drop_last: True
  • dataloader_num_workers: 0
  • dataloader_pin_memory: True
  • dataloader_persistent_workers: False
  • dataloader_prefetch_factor: None
  • remove_unused_columns: True
  • label_names: None
  • train_sampling_strategy: random
  • length_column_name: length
  • ddp_find_unused_parameters: True
  • ddp_bucket_cap_mb: None
  • ddp_broadcast_buffers: False
  • ddp_backend: None
  • ddp_timeout: 1800
  • fsdp: []
  • fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
  • deepspeed: None
  • debug: []
  • skip_memory_metrics: True
  • do_predict: False
  • resume_from_checkpoint: None
  • warmup_ratio: None
  • local_rank: -1
  • prompts: None
  • batch_sampler: no_duplicates_hashed
  • multi_dataset_batch_sampler: proportional
  • router_mapping: {}
  • learning_rate_mapping: {}
  • mini_batch_size: 8
  • matryoshka_dims: [2048, 1024, 768, 512, 256, 128]
  • use_lora: False
  • lora_r: 32
  • lora_alpha: 32
  • lora_dropout: 0.05
  • lora_target_modules: ['q_proj', 'k_proj', 'v_proj', 'o_proj', 'gate_proj', 'up_proj', 'down_proj']
  • use_self_guide: False
  • self_guide_margin: -0.1

Training Logs

Click to expand
Epoch Step Training Loss kovidore-v2-cybersecurity-beir-eval_cosine_ndcg@10 kovidore-v2-hr-beir-eval_cosine_ndcg@10 kovidore-v2-energy-beir-eval_cosine_ndcg@10 kovidore-v2-economic-beir-eval_cosine_ndcg@10
0 0 - 0.6056 0.1877 0.4050 0.1478
0.0007 1 19.0919 - - - -
0.0014 2 19.8867 - - - -
0.0022 3 19.5917 - - - -
0.0029 4 19.1449 - - - -
0.0036 5 19.3840 - - - -
0.0043 6 20.0008 - - - -
0.0051 7 19.0200 - - - -
0.0058 8 19.2317 - - - -
0.0065 9 19.3274 - - - -
0.0072 10 18.6426 - - - -
0.0079 11 19.6216 - - - -
0.0087 12 19.2203 - - - -
0.0094 13 18.5694 - - - -
0.0101 14 18.8146 - - - -
0.0108 15 18.9514 - - - -
0.0116 16 18.0845 - - - -
0.0123 17 16.9328 - - - -
0.0130 18 17.3781 - - - -
0.0137 19 17.1977 - - - -
0.0145 20 17.0873 - - - -
0.0152 21 16.2790 - - - -
0.0159 22 16.2738 - - - -
0.0166 23 16.5812 - - - -
0.0173 24 16.4922 - - - -
0.0181 25 15.8195 - - - -
0.0188 26 16.2999 - - - -
0.0195 27 15.0997 - - - -
0.0202 28 15.2898 - - - -
0.0210 29 15.2226 - - - -
0.0217 30 14.5302 - - - -
0.0224 31 14.2536 - - - -
0.0231 32 14.1144 - - - -
0.0238 33 13.7726 - - - -
0.0246 34 13.0787 - - - -
0.0253 35 13.3732 - - - -
0.0260 36 13.0835 - - - -
0.0267 37 12.8277 - - - -
0.0275 38 12.6780 - - - -
0.0282 39 12.4271 - - - -
0.0289 40 12.3580 - - - -
0.0296 41 12.0198 - - - -
0.0303 42 12.6874 - - - -
0.0311 43 12.8180 - - - -
0.0318 44 11.5252 - - - -
0.0325 45 12.6015 - - - -
0.0332 46 10.8566 - - - -
0.0340 47 11.6519 - - - -
0.0347 48 11.7856 - - - -
0.0354 49 11.1542 - - - -
0.0361 50 11.7578 - - - -
0.0368 51 11.5312 - - - -
0.0376 52 11.4435 - - - -
0.0383 53 12.1531 - - - -
0.0390 54 11.4413 - - - -
0.0397 55 11.6788 - - - -
0.0405 56 11.1894 - - - -
0.0412 57 11.1426 - - - -
0.0419 58 11.5071 - - - -
0.0426 59 11.5983 - - - -
0.0434 60 11.0551 - - - -
0.0441 61 10.2813 - - - -
0.0448 62 11.5840 - - - -
0.0455 63 10.4358 - - - -
0.0462 64 10.3742 - - - -
0.0470 65 11.0668 - - - -
0.0477 66 10.2637 - - - -
0.0484 67 10.0504 - - - -
0.0491 68 10.6066 - - - -
0.0499 69 9.9561 - - - -
0.0506 70 9.9868 - - - -
0.0513 71 9.8717 - - - -
0.0520 72 10.5210 - - - -
0.0527 73 10.0393 - - - -
0.0535 74 10.6454 - - - -
0.0542 75 9.9684 - - - -
0.0549 76 9.5214 - - - -
0.0556 77 10.0693 - - - -
0.0564 78 10.5039 - - - -
0.0571 79 10.1645 - - - -
0.0578 80 10.3510 - - - -
0.0585 81 9.0350 - - - -
0.0592 82 9.4375 - - - -
0.0600 83 9.3925 - - - -
0.0607 84 9.0280 - - - -
0.0614 85 9.6051 - - - -
0.0621 86 9.8118 - - - -
0.0629 87 8.7345 - - - -
0.0636 88 9.2292 - - - -
0.0643 89 9.4511 - - - -
0.0650 90 8.9964 - - - -
0.0658 91 8.9374 - - - -
0.0665 92 9.4078 - - - -
0.0672 93 9.7125 - - - -
0.0679 94 9.4957 - - - -
0.0686 95 8.6961 - - - -
0.0694 96 8.8827 - - - -
0.0701 97 9.0507 - - - -
0.0708 98 8.2216 - - - -
0.0715 99 8.4956 - - - -
0.0723 100 8.6325 0.6742 0.3172 0.5185 0.2072
0.0730 101 9.5200 - - - -
0.0737 102 8.8228 - - - -
0.0744 103 8.8142 - - - -
0.0751 104 8.6033 - - - -
0.0759 105 8.9870 - - - -
0.0766 106 8.5835 - - - -
0.0773 107 8.6829 - - - -
0.0780 108 8.2830 - - - -
0.0788 109 8.6042 - - - -
0.0795 110 7.9054 - - - -
0.0802 111 8.8614 - - - -
0.0809 112 8.4062 - - - -
0.0816 113 8.9702 - - - -
0.0824 114 8.2764 - - - -
0.0831 115 8.2097 - - - -
0.0838 116 7.8429 - - - -
0.0845 117 8.7368 - - - -
0.0853 118 8.3684 - - - -
0.0860 119 8.1289 - - - -
0.0867 120 7.8589 - - - -
0.0874 121 8.3147 - - - -
0.0882 122 8.2876 - - - -
0.0889 123 8.2678 - - - -
0.0896 124 8.5950 - - - -
0.0903 125 8.7891 - - - -
0.0910 126 8.3199 - - - -
0.0918 127 8.4374 - - - -
0.0925 128 8.3170 - - - -
0.0932 129 8.1996 - - - -
0.0939 130 7.9703 - - - -
0.0947 131 8.4551 - - - -
0.0954 132 8.2848 - - - -
0.0961 133 7.7070 - - - -
0.0968 134 8.2779 - - - -
0.0975 135 8.1997 - - - -
0.0983 136 8.0540 - - - -
0.0990 137 8.2734 - - - -
0.0997 138 8.0741 - - - -
0.1004 139 8.2742 - - - -
0.1012 140 8.5328 - - - -
0.1019 141 8.0972 - - - -
0.1026 142 7.8412 - - - -
0.1033 143 8.0742 - - - -
0.1040 144 8.3305 - - - -
0.1048 145 8.2164 - - - -
0.1055 146 8.2332 - - - -
0.1062 147 8.9792 - - - -
0.1069 148 8.4994 - - - -
0.1077 149 7.7255 - - - -
0.1084 150 8.0231 - - - -
0.1091 151 8.3959 - - - -
0.1098 152 8.3997 - - - -
0.1105 153 8.2747 - - - -
0.1113 154 8.3838 - - - -
0.1120 155 7.8968 - - - -
0.1127 156 7.2480 - - - -
0.1134 157 7.3077 - - - -
0.1142 158 7.7862 - - - -
0.1149 159 7.9345 - - - -
0.1156 160 7.4820 - - - -
0.1163 161 6.9438 - - - -
0.1171 162 7.5755 - - - -
0.1178 163 8.0783 - - - -
0.1185 164 7.8913 - - - -
0.1192 165 8.3917 - - - -
0.1199 166 7.9000 - - - -
0.1207 167 7.3779 - - - -
0.1214 168 7.6499 - - - -
0.1221 169 7.8189 - - - -
0.1228 170 7.0421 - - - -
0.1236 171 7.5455 - - - -
0.1243 172 7.6591 - - - -
0.125 173 7.5315 - - - -
0.1257 174 6.9696 - - - -
0.1264 175 8.0363 - - - -
0.1272 176 7.5222 - - - -
0.1279 177 7.3863 - - - -
0.1286 178 7.7400 - - - -
0.1293 179 7.3972 - - - -
0.1301 180 7.2888 - - - -
0.1308 181 7.2564 - - - -
0.1315 182 8.3560 - - - -
0.1322 183 7.2628 - - - -
0.1329 184 7.5267 - - - -
0.1337 185 7.0959 - - - -
0.1344 186 7.8697 - - - -
0.1351 187 7.7619 - - - -
0.1358 188 7.8522 - - - -
0.1366 189 7.2222 - - - -
0.1373 190 8.1619 - - - -
0.1380 191 7.0979 - - - -
0.1387 192 7.7890 - - - -
0.1395 193 7.1465 - - - -
0.1402 194 7.5562 - - - -
0.1409 195 7.3665 - - - -
0.1416 196 7.6017 - - - -
0.1423 197 7.4089 - - - -
0.1431 198 7.1814 - - - -
0.1438 199 7.8917 - - - -
0.1445 200 7.3054 0.7095 0.3974 0.5768 0.2234
0.1452 201 7.3791 - - - -
0.1460 202 7.4072 - - - -
0.1467 203 7.2233 - - - -
0.1474 204 7.4428 - - - -
0.1481 205 7.0956 - - - -
0.1488 206 7.1356 - - - -
0.1496 207 7.5965 - - - -
0.1503 208 7.0760 - - - -
0.1510 209 6.9718 - - - -
0.1517 210 7.6275 - - - -
0.1525 211 7.3305 - - - -
0.1532 212 7.0589 - - - -
0.1539 213 6.5722 - - - -
0.1546 214 7.1010 - - - -
0.1553 215 7.2543 - - - -
0.1561 216 6.8287 - - - -
0.1568 217 7.3022 - - - -
0.1575 218 7.3148 - - - -
0.1582 219 7.9304 - - - -
0.1590 220 7.0423 - - - -
0.1597 221 7.7273 - - - -
0.1604 222 6.9361 - - - -
0.1611 223 7.4043 - - - -
0.1618 224 7.3229 - - - -
0.1626 225 6.7463 - - - -
0.1633 226 6.8738 - - - -
0.1640 227 6.9864 - - - -
0.1647 228 6.8369 - - - -
0.1655 229 6.7687 - - - -
0.1662 230 7.3279 - - - -
0.1669 231 7.0851 - - - -
0.1676 232 7.3219 - - - -
0.1684 233 7.3738 - - - -
0.1691 234 7.2146 - - - -
0.1698 235 7.0031 - - - -
0.1705 236 7.1412 - - - -
0.1712 237 7.5720 - - - -
0.1720 238 6.8536 - - - -
0.1727 239 7.1221 - - - -
0.1734 240 6.5531 - - - -
0.1741 241 7.3498 - - - -
0.1749 242 7.5949 - - - -
0.1756 243 6.8010 - - - -
0.1763 244 7.4146 - - - -
0.1770 245 7.0634 - - - -
0.1777 246 7.5824 - - - -
0.1785 247 6.9042 - - - -
0.1792 248 6.7485 - - - -
0.1799 249 6.4726 - - - -
0.1806 250 6.7431 - - - -
0.1814 251 7.1589 - - - -
0.1821 252 7.0699 - - - -
0.1828 253 6.8825 - - - -
0.1835 254 6.3211 - - - -
0.1842 255 7.3109 - - - -
0.1850 256 6.7846 - - - -
0.1857 257 7.0479 - - - -
0.1864 258 6.4024 - - - -
0.1871 259 7.1798 - - - -
0.1879 260 7.1684 - - - -
0.1886 261 7.1546 - - - -
0.1893 262 6.8526 - - - -
0.1900 263 6.9781 - - - -
0.1908 264 7.0425 - - - -
0.1915 265 7.0311 - - - -
0.1922 266 7.2632 - - - -
0.1929 267 6.4864 - - - -
0.1936 268 6.9299 - - - -
0.1944 269 6.4814 - - - -
0.1951 270 6.6264 - - - -
0.1958 271 6.9644 - - - -
0.1965 272 6.7054 - - - -
0.1973 273 7.0413 - - - -
0.1980 274 6.7343 - - - -
0.1987 275 6.3281 - - - -
0.1994 276 7.0185 - - - -
0.2001 277 6.7784 - - - -
0.2009 278 7.0943 - - - -
0.2016 279 6.8568 - - - -
0.2023 280 6.7533 - - - -
0.2030 281 6.8833 - - - -
0.2038 282 7.0575 - - - -
0.2045 283 7.2078 - - - -
0.2052 284 6.8022 - - - -
0.2059 285 6.9258 - - - -
0.2066 286 6.6574 - - - -
0.2074 287 6.4478 - - - -
0.2081 288 6.6435 - - - -
0.2088 289 7.2408 - - - -
0.2095 290 6.9058 - - - -
0.2103 291 6.4098 - - - -
0.2110 292 6.6656 - - - -
0.2117 293 6.5036 - - - -
0.2124 294 6.8235 - - - -
0.2132 295 6.9650 - - - -
0.2139 296 6.6040 - - - -
0.2146 297 6.2542 - - - -
0.2153 298 6.8384 - - - -
0.2160 299 6.3351 - - - -
0.2168 300 6.6346 0.6961 0.4173 0.6300 0.2373
0.2175 301 6.6551 - - - -
0.2182 302 6.3409 - - - -
0.2189 303 6.7351 - - - -
0.2197 304 6.5580 - - - -
0.2204 305 6.4818 - - - -
0.2211 306 6.9262 - - - -
0.2218 307 6.4767 - - - -
0.2225 308 7.1219 - - - -
0.2233 309 7.2697 - - - -
0.2240 310 7.2595 - - - -
0.2247 311 6.6624 - - - -
0.2254 312 6.7634 - - - -
0.2262 313 6.3625 - - - -
0.2269 314 6.8065 - - - -
0.2276 315 6.5250 - - - -
0.2283 316 6.8302 - - - -
0.2290 317 6.3669 - - - -
0.2298 318 6.6789 - - - -
0.2305 319 7.0871 - - - -
0.2312 320 6.3874 - - - -
0.2319 321 6.8269 - - - -
0.2327 322 6.5034 - - - -
0.2334 323 6.4605 - - - -
0.2341 324 6.5802 - - - -
0.2348 325 6.6640 - - - -
0.2355 326 6.9172 - - - -
0.2363 327 6.2056 - - - -
0.2370 328 6.2234 - - - -
0.2377 329 6.4409 - - - -
0.2384 330 7.0800 - - - -
0.2392 331 7.1203 - - - -
0.2399 332 6.9144 - - - -
0.2406 333 6.5471 - - - -
0.2413 334 6.2105 - - - -
0.2421 335 6.0218 - - - -
0.2428 336 6.3294 - - - -
0.2435 337 6.3686 - - - -
0.2442 338 6.4527 - - - -
0.2449 339 6.6454 - - - -
0.2457 340 6.3885 - - - -
0.2464 341 6.0205 - - - -
0.2471 342 6.9234 - - - -
0.2478 343 6.6051 - - - -
0.2486 344 6.3341 - - - -
0.2493 345 7.1665 - - - -
0.25 346 7.2850 - - - -
0.2507 347 6.0555 - - - -
0.2514 348 6.5324 - - - -
0.2522 349 6.2765 - - - -
0.2529 350 6.5257 - - - -
0.2536 351 6.5840 - - - -
0.2543 352 6.2128 - - - -
0.2551 353 6.0990 - - - -
0.2558 354 6.6854 - - - -
0.2565 355 6.7152 - - - -
0.2572 356 6.9457 - - - -
0.2579 357 6.3394 - - - -
0.2587 358 6.1567 - - - -
0.2594 359 6.1628 - - - -
0.2601 360 6.5172 - - - -
0.2608 361 6.7857 - - - -
0.2616 362 5.7033 - - - -
0.2623 363 6.7624 - - - -
0.2630 364 6.1808 - - - -
0.2637 365 6.1666 - - - -
0.2645 366 6.5934 - - - -
0.2652 367 6.3111 - - - -
0.2659 368 6.8399 - - - -
0.2666 369 6.3754 - - - -
0.2673 370 6.0622 - - - -
0.2681 371 6.1815 - - - -
0.2688 372 6.3947 - - - -
0.2695 373 6.8556 - - - -
0.2702 374 6.4628 - - - -
0.2710 375 5.7954 - - - -
0.2717 376 6.5955 - - - -
0.2724 377 6.5673 - - - -
0.2731 378 6.0147 - - - -
0.2738 379 6.0313 - - - -
0.2746 380 6.4084 - - - -
0.2753 381 5.9687 - - - -
0.2760 382 6.9771 - - - -
0.2767 383 6.8002 - - - -
0.2775 384 6.1129 - - - -
0.2782 385 6.6863 - - - -
0.2789 386 6.8173 - - - -
0.2796 387 6.6974 - - - -
0.2803 388 5.9150 - - - -
0.2811 389 6.4683 - - - -
0.2818 390 5.9899 - - - -
0.2825 391 6.5724 - - - -
0.2832 392 6.3297 - - - -
0.2840 393 6.5680 - - - -
0.2847 394 6.3029 - - - -
0.2854 395 6.4029 - - - -
0.2861 396 6.0918 - - - -
0.2868 397 6.0929 - - - -
0.2876 398 6.3182 - - - -
0.2883 399 6.7178 - - - -
0.2890 400 6.6203 0.7063 0.4261 0.6266 0.2745
0.2897 401 6.4766 - - - -
0.2905 402 6.4485 - - - -
0.2912 403 6.2265 - - - -
0.2919 404 6.0524 - - - -
0.2926 405 5.6111 - - - -
0.2934 406 5.5223 - - - -
0.2941 407 5.9818 - - - -
0.2948 408 6.3295 - - - -
0.2955 409 6.4862 - - - -
0.2962 410 6.3428 - - - -
0.2970 411 6.2275 - - - -
0.2977 412 6.5270 - - - -
0.2984 413 6.3285 - - - -
0.2991 414 6.3125 - - - -
0.2999 415 5.9052 - - - -
0.3006 416 5.7915 - - - -
0.3013 417 6.0990 - - - -
0.3020 418 6.1836 - - - -
0.3027 419 5.9840 - - - -
0.3035 420 6.4840 - - - -
0.3042 421 6.1691 - - - -
0.3049 422 5.7964 - - - -
0.3056 423 6.5323 - - - -
0.3064 424 6.2221 - - - -
0.3071 425 6.4264 - - - -
0.3078 426 5.9390 - - - -
0.3085 427 6.3184 - - - -
0.3092 428 6.2256 - - - -
0.3100 429 5.8800 - - - -
0.3107 430 6.4156 - - - -
0.3114 431 6.3997 - - - -
0.3121 432 6.5197 - - - -
0.3129 433 5.7554 - - - -
0.3136 434 6.6211 - - - -
0.3143 435 6.0932 - - - -
0.3150 436 6.1628 - - - -
0.3158 437 6.1239 - - - -
0.3165 438 6.0597 - - - -
0.3172 439 6.0002 - - - -
0.3179 440 6.1287 - - - -
0.3186 441 6.5219 - - - -
0.3194 442 6.1273 - - - -
0.3201 443 6.5010 - - - -
0.3208 444 5.7013 - - - -
0.3215 445 6.5433 - - - -
0.3223 446 5.8138 - - - -
0.3230 447 6.0996 - - - -
0.3237 448 5.6238 - - - -
0.3244 449 6.1883 - - - -
0.3251 450 6.2648 - - - -
0.3259 451 6.0864 - - - -
0.3266 452 6.3402 - - - -
0.3273 453 6.3547 - - - -
0.3280 454 6.2943 - - - -
0.3288 455 5.9182 - - - -
0.3295 456 6.1172 - - - -
0.3302 457 6.4045 - - - -
0.3309 458 6.0149 - - - -
0.3316 459 5.9604 - - - -
0.3324 460 6.2042 - - - -
0.3331 461 5.5506 - - - -
0.3338 462 6.1752 - - - -
0.3345 463 5.9065 - - - -
0.3353 464 5.9777 - - - -
0.3360 465 6.3311 - - - -
0.3367 466 5.9243 - - - -
0.3374 467 5.3650 - - - -
0.3382 468 6.4132 - - - -
0.3389 469 5.6243 - - - -
0.3396 470 5.9061 - - - -
0.3403 471 5.9840 - - - -
0.3410 472 6.2254 - - - -
0.3418 473 6.0129 - - - -
0.3425 474 5.9334 - - - -
0.3432 475 6.0941 - - - -
0.3439 476 5.4651 - - - -
0.3447 477 5.8315 - - - -
0.3454 478 5.9587 - - - -
0.3461 479 5.9884 - - - -
0.3468 480 6.1707 - - - -
0.3475 481 6.1964 - - - -
0.3483 482 6.3515 - - - -
0.3490 483 5.6005 - - - -
0.3497 484 6.3659 - - - -
0.3504 485 6.1487 - - - -
0.3512 486 6.1861 - - - -
0.3519 487 6.0183 - - - -
0.3526 488 5.5458 - - - -
0.3533 489 5.6686 - - - -
0.3540 490 6.1243 - - - -
0.3548 491 5.9261 - - - -
0.3555 492 6.3979 - - - -
0.3562 493 6.2232 - - - -
0.3569 494 5.9405 - - - -
0.3577 495 5.8329 - - - -
0.3584 496 6.0807 - - - -
0.3591 497 6.2127 - - - -
0.3598 498 6.7795 - - - -
0.3605 499 5.8911 - - - -
0.3613 500 5.4120 0.6873 0.4311 0.6263 0.3009
0.3620 501 5.7659 - - - -
0.3627 502 6.1646 - - - -
0.3634 503 6.1807 - - - -
0.3642 504 5.7041 - - - -
0.3649 505 5.8857 - - - -
0.3656 506 5.9553 - - - -
0.3663 507 5.4332 - - - -
0.3671 508 6.4178 - - - -
0.3678 509 5.6180 - - - -
0.3685 510 5.8307 - - - -
0.3692 511 6.1445 - - - -
0.3699 512 5.7186 - - - -
0.3707 513 5.4725 - - - -
0.3714 514 5.9443 - - - -
0.3721 515 5.9112 - - - -
0.3728 516 5.4384 - - - -
0.3736 517 5.9721 - - - -
0.3743 518 5.6069 - - - -
0.375 519 5.8900 - - - -
0.3757 520 5.6062 - - - -
0.3764 521 5.4134 - - - -
0.3772 522 5.4031 - - - -
0.3779 523 6.1456 - - - -
0.3786 524 6.0487 - - - -
0.3793 525 5.5949 - - - -
0.3801 526 6.1031 - - - -
0.3808 527 5.6685 - - - -
0.3815 528 6.0260 - - - -
0.3822 529 6.2111 - - - -
0.3829 530 6.0693 - - - -
0.3837 531 6.1479 - - - -
0.3844 532 5.9344 - - - -
0.3851 533 5.8148 - - - -
0.3858 534 5.7057 - - - -
0.3866 535 6.3075 - - - -
0.3873 536 5.8287 - - - -
0.3880 537 6.0850 - - - -
0.3887 538 5.8637 - - - -
0.3895 539 6.4192 - - - -
0.3902 540 5.2509 - - - -
0.3909 541 5.3246 - - - -
0.3916 542 5.7403 - - - -
0.3923 543 5.7188 - - - -
0.3931 544 5.9270 - - - -
0.3938 545 5.8446 - - - -
0.3945 546 5.8825 - - - -
0.3952 547 5.5936 - - - -
0.3960 548 5.2857 - - - -
0.3967 549 5.4691 - - - -
0.3974 550 5.4397 - - - -
0.3981 551 5.5301 - - - -
0.3988 552 5.8109 - - - -
0.3996 553 5.7981 - - - -
0.4003 554 6.1828 - - - -
0.4010 555 6.0433 - - - -
0.4017 556 5.6751 - - - -
0.4025 557 5.4919 - - - -
0.4032 558 6.3104 - - - -
0.4039 559 6.2510 - - - -
0.4046 560 6.5036 - - - -
0.4053 561 5.8318 - - - -
0.4061 562 5.4669 - - - -
0.4068 563 5.5969 - - - -
0.4075 564 5.3740 - - - -
0.4082 565 5.5248 - - - -
0.4090 566 5.7616 - - - -
0.4097 567 5.4895 - - - -
0.4104 568 6.2580 - - - -
0.4111 569 6.1075 - - - -
0.4118 570 5.2255 - - - -
0.4126 571 6.0526 - - - -
0.4133 572 5.7407 - - - -
0.4140 573 5.4861 - - - -
0.4147 574 5.8820 - - - -
0.4155 575 5.7769 - - - -
0.4162 576 5.2120 - - - -
0.4169 577 5.7118 - - - -
0.4176 578 5.9973 - - - -
0.4184 579 5.5964 - - - -
0.4191 580 5.3766 - - - -
0.4198 581 5.8834 - - - -
0.4205 582 5.4108 - - - -
0.4212 583 5.7598 - - - -
0.4220 584 5.5675 - - - -
0.4227 585 5.9293 - - - -
0.4234 586 5.8521 - - - -
0.4241 587 5.8206 - - - -
0.4249 588 5.6548 - - - -
0.4256 589 5.7292 - - - -
0.4263 590 5.5553 - - - -
0.4270 591 5.2298 - - - -
0.4277 592 5.8907 - - - -
0.4285 593 5.8722 - - - -
0.4292 594 5.6503 - - - -
0.4299 595 5.7988 - - - -
0.4306 596 5.9189 - - - -
0.4314 597 6.1421 - - - -
0.4321 598 5.4830 - - - -
0.4328 599 5.4684 - - - -
0.4335 600 5.4809 0.7227 0.4340 0.6478 0.2889
0.4342 601 6.3571 - - - -
0.4350 602 5.2980 - - - -
0.4357 603 5.5425 - - - -
0.4364 604 5.5860 - - - -
0.4371 605 5.7271 - - - -
0.4379 606 6.0694 - - - -
0.4386 607 5.0925 - - - -
0.4393 608 5.9612 - - - -
0.4400 609 5.5533 - - - -
0.4408 610 6.2882 - - - -
0.4415 611 6.3086 - - - -
0.4422 612 6.0757 - - - -
0.4429 613 5.2792 - - - -
0.4436 614 5.4689 - - - -
0.4444 615 5.9192 - - - -
0.4451 616 6.1686 - - - -
0.4458 617 6.2171 - - - -
0.4465 618 5.3770 - - - -
0.4473 619 5.6390 - - - -
0.4480 620 5.9013 - - - -
0.4487 621 5.7070 - - - -
0.4494 622 5.9648 - - - -
0.4501 623 5.3286 - - - -
0.4509 624 5.6123 - - - -
0.4516 625 5.7483 - - - -
0.4523 626 5.8008 - - - -
0.4530 627 5.4062 - - - -
0.4538 628 5.3543 - - - -
0.4545 629 5.5496 - - - -
0.4552 630 5.4672 - - - -
0.4559 631 6.1373 - - - -
0.4566 632 5.2992 - - - -
0.4574 633 5.5227 - - - -
0.4581 634 5.2929 - - - -
0.4588 635 5.8081 - - - -
0.4595 636 5.6275 - - - -
0.4603 637 5.6039 - - - -
0.4610 638 5.7041 - - - -
0.4617 639 5.9905 - - - -
0.4624 640 5.8135 - - - -
0.4632 641 5.4828 - - - -
0.4639 642 5.5334 - - - -
0.4646 643 5.7765 - - - -
0.4653 644 5.4622 - - - -
0.4660 645 5.9345 - - - -
0.4668 646 5.6695 - - - -
0.4675 647 5.8981 - - - -
0.4682 648 5.1928 - - - -
0.4689 649 5.7016 - - - -
0.4697 650 5.6331 - - - -
0.4704 651 5.5933 - - - -
0.4711 652 5.7944 - - - -
0.4718 653 5.2045 - - - -
0.4725 654 5.5552 - - - -
0.4733 655 5.1802 - - - -
0.4740 656 5.4465 - - - -
0.4747 657 5.2717 - - - -
0.4754 658 5.9444 - - - -
0.4762 659 5.3047 - - - -
0.4769 660 5.0969 - - - -
0.4776 661 5.2778 - - - -
0.4783 662 5.9999 - - - -
0.4790 663 5.3729 - - - -
0.4798 664 6.0432 - - - -
0.4805 665 5.3390 - - - -
0.4812 666 5.5912 - - - -
0.4819 667 5.3974 - - - -
0.4827 668 5.8361 - - - -
0.4834 669 5.6753 - - - -
0.4841 670 5.3613 - - - -
0.4848 671 5.7685 - - - -
0.4855 672 5.6002 - - - -
0.4863 673 4.8733 - - - -
0.4870 674 5.0298 - - - -
0.4877 675 5.7031 - - - -
0.4884 676 5.5347 - - - -
0.4892 677 5.3629 - - - -
0.4899 678 6.2798 - - - -
0.4906 679 6.0948 - - - -
0.4913 680 5.4967 - - - -
0.4921 681 5.7789 - - - -
0.4928 682 5.4679 - - - -
0.4935 683 5.5637 - - - -
0.4942 684 5.7655 - - - -
0.4949 685 5.9590 - - - -
0.4957 686 5.9958 - - - -
0.4964 687 5.4186 - - - -
0.4971 688 5.8459 - - - -
0.4978 689 5.3759 - - - -
0.4986 690 5.9028 - - - -
0.4993 691 5.7153 - - - -
0.5 692 5.3532 - - - -
0.5007 693 5.9408 - - - -
0.5014 694 5.8706 - - - -
0.5022 695 5.4715 - - - -
0.5029 696 5.5752 - - - -
0.5036 697 5.8098 - - - -
0.5043 698 5.9875 - - - -
0.5051 699 5.9453 - - - -
0.5058 700 5.7428 0.7249 0.4612 0.6480 0.2856
0.5065 701 5.7106 - - - -
0.5072 702 5.5472 - - - -
0.5079 703 5.4292 - - - -
0.5087 704 5.5662 - - - -
0.5094 705 5.4392 - - - -
0.5101 706 5.4650 - - - -
0.5108 707 5.7518 - - - -
0.5116 708 5.2709 - - - -
0.5123 709 5.7169 - - - -
0.5130 710 5.6891 - - - -
0.5137 711 5.5677 - - - -
0.5145 712 5.7166 - - - -
0.5152 713 6.1221 - - - -
0.5159 714 5.3410 - - - -
0.5166 715 5.6674 - - - -
0.5173 716 5.3749 - - - -
0.5181 717 5.9125 - - - -
0.5188 718 5.9973 - - - -
0.5195 719 5.9586 - - - -
0.5202 720 5.5761 - - - -
0.5210 721 4.9199 - - - -
0.5217 722 5.0281 - - - -
0.5224 723 5.5164 - - - -
0.5231 724 5.9017 - - - -
0.5238 725 5.9823 - - - -
0.5246 726 5.1934 - - - -
0.5253 727 5.6346 - - - -
0.5260 728 5.3326 - - - -
0.5267 729 5.4227 - - - -
0.5275 730 5.3620 - - - -
0.5282 731 5.6070 - - - -
0.5289 732 4.9486 - - - -
0.5296 733 5.1889 - - - -
0.5303 734 5.9608 - - - -
0.5311 735 5.3768 - - - -
0.5318 736 5.7505 - - - -
0.5325 737 5.7834 - - - -
0.5332 738 5.3426 - - - -
0.5340 739 5.7701 - - - -
0.5347 740 5.2069 - - - -
0.5354 741 5.1393 - - - -
0.5361 742 6.0787 - - - -
0.5368 743 5.4940 - - - -
0.5376 744 5.6890 - - - -
0.5383 745 5.6878 - - - -
0.5390 746 5.9458 - - - -
0.5397 747 5.3496 - - - -
0.5405 748 5.4962 - - - -
0.5412 749 5.3545 - - - -
0.5419 750 5.5793 - - - -
0.5426 751 5.8939 - - - -
0.5434 752 5.9211 - - - -
0.5441 753 5.4365 - - - -
0.5448 754 5.2320 - - - -
0.5455 755 5.5897 - - - -
0.5462 756 6.0368 - - - -
0.5470 757 5.6072 - - - -
0.5477 758 5.5788 - - - -
0.5484 759 5.1545 - - - -
0.5491 760 5.4884 - - - -
0.5499 761 5.0884 - - - -
0.5506 762 5.5645 - - - -
0.5513 763 5.3196 - - - -
0.5520 764 5.7170 - - - -
0.5527 765 5.2632 - - - -
0.5535 766 5.1419 - - - -
0.5542 767 5.9543 - - - -
0.5549 768 5.3513 - - - -
0.5556 769 5.6021 - - - -
0.5564 770 5.7050 - - - -
0.5571 771 5.6685 - - - -
0.5578 772 5.6102 - - - -
0.5585 773 5.8383 - - - -
0.5592 774 5.2930 - - - -
0.5600 775 5.3665 - - - -
0.5607 776 5.3801 - - - -
0.5614 777 5.2079 - - - -
0.5621 778 5.4669 - - - -
0.5629 779 5.2137 - - - -
0.5636 780 5.7097 - - - -
0.5643 781 5.7150 - - - -
0.5650 782 5.3798 - - - -
0.5658 783 5.5040 - - - -
0.5665 784 5.5099 - - - -
0.5672 785 5.3095 - - - -
0.5679 786 6.0308 - - - -
0.5686 787 5.7135 - - - -
0.5694 788 5.4731 - - - -
0.5701 789 5.3736 - - - -
0.5708 790 5.6727 - - - -
0.5715 791 5.1868 - - - -
0.5723 792 5.2648 - - - -
0.5730 793 5.4526 - - - -
0.5737 794 5.2418 - - - -
0.5744 795 5.3114 - - - -
0.5751 796 5.7206 - - - -
0.5759 797 5.3423 - - - -
0.5766 798 5.6018 - - - -
0.5773 799 4.6159 - - - -
0.5780 800 5.3113 0.7340 0.4587 0.6473 0.2699
0.5788 801 5.3208 - - - -
0.5795 802 5.4184 - - - -
0.5802 803 5.2078 - - - -
0.5809 804 5.0785 - - - -
0.5816 805 5.4797 - - - -
0.5824 806 5.4417 - - - -
0.5831 807 5.8505 - - - -
0.5838 808 5.8814 - - - -
0.5845 809 5.1203 - - - -
0.5853 810 5.7004 - - - -
0.5860 811 5.4516 - - - -
0.5867 812 5.3818 - - - -
0.5874 813 5.9808 - - - -
0.5882 814 5.5365 - - - -
0.5889 815 5.3635 - - - -
0.5896 816 5.5098 - - - -
0.5903 817 5.6043 - - - -
0.5910 818 5.5522 - - - -
0.5918 819 5.2283 - - - -
0.5925 820 5.4756 - - - -
0.5932 821 5.6254 - - - -
0.5939 822 5.2648 - - - -
0.5947 823 5.4985 - - - -
0.5954 824 5.5699 - - - -
0.5961 825 4.6084 - - - -
0.5968 826 5.6295 - - - -
0.5975 827 5.2383 - - - -
0.5983 828 5.2299 - - - -
0.5990 829 5.5941 - - - -
0.5997 830 5.7599 - - - -
0.6004 831 5.5748 - - - -
0.6012 832 5.2531 - - - -
0.6019 833 5.1027 - - - -
0.6026 834 4.6827 - - - -
0.6033 835 5.7674 - - - -
0.6040 836 5.5569 - - - -
0.6048 837 5.1906 - - - -
0.6055 838 5.3354 - - - -
0.6062 839 5.2223 - - - -
0.6069 840 5.1798 - - - -
0.6077 841 5.5039 - - - -
0.6084 842 5.2668 - - - -
0.6091 843 5.3159 - - - -
0.6098 844 5.7808 - - - -
0.6105 845 5.4349 - - - -
0.6113 846 5.4686 - - - -
0.6120 847 5.2482 - - - -
0.6127 848 5.3649 - - - -
0.6134 849 5.4009 - - - -
0.6142 850 5.3288 - - - -
0.6149 851 5.1974 - - - -
0.6156 852 5.3397 - - - -
0.6163 853 5.7956 - - - -
0.6171 854 5.8062 - - - -
0.6178 855 5.6495 - - - -
0.6185 856 4.9773 - - - -
0.6192 857 5.0549 - - - -
0.6199 858 5.2714 - - - -
0.6207 859 4.9813 - - - -
0.6214 860 5.6390 - - - -
0.6221 861 4.9765 - - - -
0.6228 862 5.4202 - - - -
0.6236 863 5.0820 - - - -
0.6243 864 5.0654 - - - -
0.625 865 5.7452 - - - -
0.6257 866 5.9088 - - - -
0.6264 867 5.6568 - - - -
0.6272 868 5.2553 - - - -
0.6279 869 5.0427 - - - -
0.6286 870 5.3327 - - - -
0.6293 871 5.2786 - - - -
0.6301 872 5.4707 - - - -
0.6308 873 5.4248 - - - -
0.6315 874 5.3564 - - - -
0.6322 875 5.7951 - - - -
0.6329 876 5.5483 - - - -
0.6337 877 5.4586 - - - -
0.6344 878 5.4209 - - - -
0.6351 879 5.0874 - - - -
0.6358 880 5.2270 - - - -
0.6366 881 5.2370 - - - -
0.6373 882 5.0492 - - - -
0.6380 883 5.1216 - - - -
0.6387 884 5.7816 - - - -
0.6395 885 5.4257 - - - -
0.6402 886 5.5634 - - - -
0.6409 887 5.3597 - - - -
0.6416 888 5.1692 - - - -
0.6423 889 5.5065 - - - -
0.6431 890 5.5849 - - - -
0.6438 891 4.8882 - - - -
0.6445 892 5.6733 - - - -
0.6452 893 5.4857 - - - -
0.6460 894 5.3196 - - - -
0.6467 895 5.1864 - - - -
0.6474 896 5.2122 - - - -
0.6481 897 5.1939 - - - -
0.6488 898 5.2128 - - - -
0.6496 899 5.1604 - - - -
0.6503 900 5.6310 0.7245 0.4663 0.6541 0.2772
0.6510 901 5.2647 - - - -
0.6517 902 5.0958 - - - -
0.6525 903 5.6578 - - - -
0.6532 904 5.7546 - - - -
0.6539 905 5.2322 - - - -
0.6546 906 5.1651 - - - -
0.6553 907 5.0978 - - - -
0.6561 908 5.1865 - - - -
0.6568 909 5.4624 - - - -
0.6575 910 5.0817 - - - -
0.6582 911 5.5827 - - - -
0.6590 912 5.6480 - - - -
0.6597 913 5.4339 - - - -
0.6604 914 5.4152 - - - -
0.6611 915 5.2255 - - - -
0.6618 916 5.1787 - - - -
0.6626 917 4.9578 - - - -
0.6633 918 5.2469 - - - -
0.6640 919 5.0956 - - - -
0.6647 920 5.2729 - - - -
0.6655 921 5.0331 - - - -
0.6662 922 5.2953 - - - -
0.6669 923 5.4655 - - - -
0.6676 924 5.4738 - - - -
0.6684 925 5.4285 - - - -
0.6691 926 5.2189 - - - -
0.6698 927 5.2585 - - - -
0.6705 928 5.1233 - - - -
0.6712 929 5.6659 - - - -
0.6720 930 5.5697 - - - -
0.6727 931 4.9136 - - - -
0.6734 932 5.6263 - - - -
0.6741 933 5.1443 - - - -
0.6749 934 5.4113 - - - -
0.6756 935 5.5415 - - - -
0.6763 936 4.8751 - - - -
0.6770 937 5.1266 - - - -
0.6777 938 5.6597 - - - -
0.6785 939 5.1998 - - - -
0.6792 940 5.2010 - - - -
0.6799 941 5.2973 - - - -
0.6806 942 5.5050 - - - -
0.6814 943 4.9403 - - - -
0.6821 944 5.7287 - - - -
0.6828 945 5.3209 - - - -
0.6835 946 5.2171 - - - -
0.6842 947 5.5262 - - - -
0.6850 948 5.2486 - - - -
0.6857 949 5.3430 - - - -
0.6864 950 5.5658 - - - -
0.6871 951 5.6849 - - - -
0.6879 952 5.4932 - - - -
0.6886 953 5.2280 - - - -
0.6893 954 5.3022 - - - -
0.6900 955 5.2211 - - - -
0.6908 956 5.3864 - - - -
0.6915 957 5.4473 - - - -
0.6922 958 5.3845 - - - -
0.6929 959 4.7171 - - - -
0.6936 960 5.3825 - - - -
0.6944 961 5.4428 - - - -
0.6951 962 4.9681 - - - -
0.6958 963 5.3186 - - - -
0.6965 964 5.2438 - - - -
0.6973 965 5.7513 - - - -
0.6980 966 5.2074 - - - -
0.6987 967 5.5972 - - - -
0.6994 968 5.0319 - - - -
0.7001 969 5.4092 - - - -
0.7009 970 5.0395 - - - -
0.7016 971 5.2044 - - - -
0.7023 972 5.5324 - - - -
0.7030 973 5.4694 - - - -
0.7038 974 5.5656 - - - -
0.7045 975 5.6317 - - - -
0.7052 976 5.5206 - - - -
0.7059 977 5.6643 - - - -
0.7066 978 5.1649 - - - -
0.7074 979 6.0422 - - - -
0.7081 980 5.7866 - - - -
0.7088 981 5.4611 - - - -
0.7095 982 5.3482 - - - -
0.7103 983 5.6990 - - - -
0.7110 984 5.4506 - - - -
0.7117 985 5.3709 - - - -
0.7124 986 5.2311 - - - -
0.7132 987 5.1362 - - - -
0.7139 988 5.6586 - - - -
0.7146 989 4.9879 - - - -
0.7153 990 5.6985 - - - -
0.7160 991 5.2650 - - - -
0.7168 992 5.5303 - - - -
0.7175 993 5.0728 - - - -
0.7182 994 5.4079 - - - -
0.7189 995 5.6700 - - - -
0.7197 996 5.3255 - - - -
0.7204 997 5.2993 - - - -
0.7211 998 5.6256 - - - -
0.7218 999 5.2808 - - - -
0.7225 1000 5.5055 0.7223 0.4691 0.6523 0.2657
0.7233 1001 5.1685 - - - -
0.7240 1002 5.0808 - - - -
0.7247 1003 5.3123 - - - -
0.7254 1004 5.2041 - - - -
0.7262 1005 5.2156 - - - -
0.7269 1006 5.5056 - - - -
0.7276 1007 5.7968 - - - -
0.7283 1008 4.8278 - - - -
0.7290 1009 5.0452 - - - -
0.7298 1010 5.3035 - - - -
0.7305 1011 5.4277 - - - -
0.7312 1012 5.5039 - - - -
0.7319 1013 5.1184 - - - -
0.7327 1014 5.4212 - - - -
0.7334 1015 5.2474 - - - -
0.7341 1016 5.7134 - - - -
0.7348 1017 5.1479 - - - -
0.7355 1018 4.9485 - - - -
0.7363 1019 5.9090 - - - -
0.7370 1020 5.2582 - - - -
0.7377 1021 5.3592 - - - -
0.7384 1022 5.1288 - - - -
0.7392 1023 5.1742 - - - -
0.7399 1024 5.2111 - - - -
0.7406 1025 5.0484 - - - -
0.7413 1026 5.4047 - - - -
0.7421 1027 5.0253 - - - -
0.7428 1028 4.9168 - - - -
0.7435 1029 5.3110 - - - -
0.7442 1030 5.7918 - - - -
0.7449 1031 5.1020 - - - -
0.7457 1032 5.9942 - - - -
0.7464 1033 4.9788 - - - -
0.7471 1034 5.3004 - - - -
0.7478 1035 5.3815 - - - -
0.7486 1036 5.7455 - - - -
0.7493 1037 5.1280 - - - -
0.75 1038 5.4730 - - - -
0.7507 1039 5.4256 - - - -
0.7514 1040 5.6683 - - - -
0.7522 1041 4.9913 - - - -
0.7529 1042 5.7886 - - - -
0.7536 1043 5.5245 - - - -
0.7543 1044 5.1682 - - - -
0.7551 1045 5.3222 - - - -
0.7558 1046 5.2782 - - - -
0.7565 1047 4.9509 - - - -
0.7572 1048 5.7216 - - - -
0.7579 1049 5.4174 - - - -
0.7587 1050 5.2517 - - - -
0.7594 1051 5.1345 - - - -
0.7601 1052 4.8413 - - - -
0.7608 1053 5.8908 - - - -
0.7616 1054 5.2968 - - - -
0.7623 1055 5.6777 - - - -
0.7630 1056 5.2377 - - - -
0.7637 1057 5.3109 - - - -
0.7645 1058 5.2000 - - - -
0.7652 1059 5.1186 - - - -
0.7659 1060 5.3536 - - - -
0.7666 1061 5.2641 - - - -
0.7673 1062 5.4459 - - - -
0.7681 1063 5.1539 - - - -
0.7688 1064 5.3753 - - - -
0.7695 1065 4.7219 - - - -
0.7702 1066 5.4860 - - - -
0.7710 1067 5.3111 - - - -
0.7717 1068 5.0592 - - - -
0.7724 1069 5.4875 - - - -
0.7731 1070 4.8750 - - - -
0.7738 1071 5.4281 - - - -
0.7746 1072 5.6073 - - - -
0.7753 1073 5.6222 - - - -
0.7760 1074 5.4030 - - - -
0.7767 1075 5.2540 - - - -
0.7775 1076 5.3791 - - - -
0.7782 1077 5.7722 - - - -
0.7789 1078 5.4970 - - - -
0.7796 1079 5.4802 - - - -
0.7803 1080 5.4868 - - - -
0.7811 1081 5.5680 - - - -
0.7818 1082 5.5559 - - - -
0.7825 1083 5.5265 - - - -
0.7832 1084 5.2988 - - - -
0.7840 1085 4.9672 - - - -
0.7847 1086 4.8483 - - - -
0.7854 1087 5.3563 - - - -
0.7861 1088 5.1705 - - - -
0.7868 1089 5.7830 - - - -
0.7876 1090 5.5567 - - - -
0.7883 1091 4.9965 - - - -
0.7890 1092 5.2197 - - - -
0.7897 1093 5.1033 - - - -
0.7905 1094 5.1716 - - - -
0.7912 1095 5.7410 - - - -
0.7919 1096 5.3409 - - - -
0.7926 1097 5.2111 - - - -
0.7934 1098 5.1350 - - - -
0.7941 1099 5.1364 - - - -
0.7948 1100 5.8232 0.7235 0.4738 0.6578 0.2646
0.7955 1101 5.5140 - - - -
0.7962 1102 5.4516 - - - -
0.7970 1103 5.6997 - - - -
0.7977 1104 5.0577 - - - -
0.7984 1105 5.7355 - - - -
0.7991 1106 5.3483 - - - -
0.7999 1107 5.2335 - - - -
0.8006 1108 5.5465 - - - -
0.8013 1109 4.7978 - - - -
0.8020 1110 5.2400 - - - -
0.8027 1111 5.3041 - - - -
0.8035 1112 5.4598 - - - -
0.8042 1113 5.1203 - - - -
0.8049 1114 5.4111 - - - -
0.8056 1115 5.1817 - - - -
0.8064 1116 5.4440 - - - -
0.8071 1117 5.2471 - - - -
0.8078 1118 5.2582 - - - -
0.8085 1119 5.8283 - - - -
0.8092 1120 5.6835 - - - -
0.8100 1121 5.3220 - - - -
0.8107 1122 5.3752 - - - -
0.8114 1123 4.8916 - - - -
0.8121 1124 5.2444 - - - -
0.8129 1125 6.2362 - - - -
0.8136 1126 4.9891 - - - -
0.8143 1127 5.4165 - - - -
0.8150 1128 5.2151 - - - -
0.8158 1129 5.6450 - - - -
0.8165 1130 5.5678 - - - -
0.8172 1131 5.2326 - - - -
0.8179 1132 5.1352 - - - -
0.8186 1133 5.2369 - - - -
0.8194 1134 5.3933 - - - -
0.8201 1135 5.2654 - - - -
0.8208 1136 5.7079 - - - -
0.8215 1137 5.5263 - - - -
0.8223 1138 5.1707 - - - -
0.8230 1139 5.4294 - - - -
0.8237 1140 5.1440 - - - -
0.8244 1141 5.1251 - - - -
0.8251 1142 5.5497 - - - -
0.8259 1143 5.1902 - - - -
0.8266 1144 5.7840 - - - -
0.8273 1145 5.3416 - - - -
0.8280 1146 5.2176 - - - -
0.8288 1147 5.3414 - - - -
0.8295 1148 4.9403 - - - -
0.8302 1149 5.5676 - - - -
0.8309 1150 5.7204 - - - -
0.8316 1151 5.2942 - - - -
0.8324 1152 4.6860 - - - -
0.8331 1153 4.8432 - - - -
0.8338 1154 5.1931 - - - -
0.8345 1155 5.0743 - - - -
0.8353 1156 5.2642 - - - -
0.8360 1157 5.2093 - - - -
0.8367 1158 5.3999 - - - -
0.8374 1159 5.6863 - - - -
0.8382 1160 5.4952 - - - -
0.8389 1161 5.4543 - - - -
0.8396 1162 5.4074 - - - -
0.8403 1163 5.0643 - - - -
0.8410 1164 5.1385 - - - -
0.8418 1165 5.0698 - - - -
0.8425 1166 5.2398 - - - -
0.8432 1167 5.1608 - - - -
0.8439 1168 4.9286 - - - -
0.8447 1169 5.1664 - - - -
0.8454 1170 5.2369 - - - -
0.8461 1171 5.4637 - - - -
0.8468 1172 5.6047 - - - -
0.8475 1173 5.6302 - - - -
0.8483 1174 5.1770 - - - -
0.8490 1175 5.4205 - - - -
0.8497 1176 5.1925 - - - -
0.8504 1177 5.4395 - - - -
0.8512 1178 5.0647 - - - -
0.8519 1179 5.3476 - - - -
0.8526 1180 5.3967 - - - -
0.8533 1181 5.4103 - - - -
0.8540 1182 4.9899 - - - -
0.8548 1183 5.2094 - - - -
0.8555 1184 5.3716 - - - -
0.8562 1185 5.3476 - - - -
0.8569 1186 5.7847 - - - -
0.8577 1187 5.0475 - - - -
0.8584 1188 5.0959 - - - -
0.8591 1189 4.9680 - - - -
0.8598 1190 5.4295 - - - -
0.8605 1191 5.2959 - - - -
0.8613 1192 5.1507 - - - -
0.8620 1193 5.1398 - - - -
0.8627 1194 5.0043 - - - -
0.8634 1195 5.3290 - - - -
0.8642 1196 5.6150 - - - -
0.8649 1197 5.4368 - - - -
0.8656 1198 4.9513 - - - -
0.8663 1199 5.6064 - - - -
0.8671 1200 5.2296 0.7210 0.4771 0.6557 0.2696
0.8678 1201 5.6796 - - - -
0.8685 1202 5.2094 - - - -
0.8692 1203 5.5388 - - - -
0.8699 1204 5.2802 - - - -
0.8707 1205 4.7212 - - - -
0.8714 1206 5.1474 - - - -
0.8721 1207 5.6223 - - - -
0.8728 1208 5.6116 - - - -
0.8736 1209 5.3112 - - - -
0.8743 1210 5.1664 - - - -
0.875 1211 5.3291 - - - -
0.8757 1212 4.9297 - - - -
0.8764 1213 5.4814 - - - -
0.8772 1214 5.6206 - - - -
0.8779 1215 5.1043 - - - -
0.8786 1216 5.2393 - - - -
0.8793 1217 5.2451 - - - -
0.8801 1218 5.6090 - - - -
0.8808 1219 5.7220 - - - -
0.8815 1220 5.5524 - - - -
0.8822 1221 4.7361 - - - -
0.8829 1222 5.4003 - - - -
0.8837 1223 4.8673 - - - -
0.8844 1224 4.9721 - - - -
0.8851 1225 5.5393 - - - -
0.8858 1226 4.8313 - - - -
0.8866 1227 5.5424 - - - -
0.8873 1228 5.4957 - - - -
0.8880 1229 5.2470 - - - -
0.8887 1230 5.3981 - - - -
0.8895 1231 5.1233 - - - -
0.8902 1232 5.4014 - - - -
0.8909 1233 5.5700 - - - -
0.8916 1234 5.1361 - - - -
0.8923 1235 5.6769 - - - -
0.8931 1236 5.5002 - - - -
0.8938 1237 5.5607 - - - -
0.8945 1238 5.4528 - - - -
0.8952 1239 5.7288 - - - -
0.8960 1240 5.0941 - - - -
0.8967 1241 4.8220 - - - -
0.8974 1242 5.3630 - - - -
0.8981 1243 6.1381 - - - -
0.8988 1244 5.7304 - - - -
0.8996 1245 5.6156 - - - -
0.9003 1246 5.8270 - - - -
0.9010 1247 5.5655 - - - -
0.9017 1248 5.6237 - - - -
0.9025 1249 5.1033 - - - -
0.9032 1250 5.4019 - - - -
0.9039 1251 5.5166 - - - -
0.9046 1252 5.4347 - - - -
0.9053 1253 6.0410 - - - -
0.9061 1254 5.2520 - - - -
0.9068 1255 5.1262 - - - -
0.9075 1256 5.5556 - - - -
0.9082 1257 4.6695 - - - -
0.9090 1258 5.4925 - - - -
0.9097 1259 5.4788 - - - -
0.9104 1260 4.9913 - - - -
0.9111 1261 5.8043 - - - -
0.9118 1262 4.9158 - - - -
0.9126 1263 6.1506 - - - -
0.9133 1264 5.7525 - - - -
0.9140 1265 5.4413 - - - -
0.9147 1266 4.9375 - - - -
0.9155 1267 5.1976 - - - -
0.9162 1268 5.3966 - - - -
0.9169 1269 4.9203 - - - -
0.9176 1270 5.1365 - - - -
0.9184 1271 4.9536 - - - -
0.9191 1272 5.7576 - - - -
0.9198 1273 5.3663 - - - -
0.9205 1274 5.1386 - - - -
0.9212 1275 5.4468 - - - -
0.9220 1276 5.4881 - - - -
0.9227 1277 5.4349 - - - -
0.9234 1278 5.4886 - - - -
0.9241 1279 5.4140 - - - -
0.9249 1280 5.4578 - - - -
0.9256 1281 5.4469 - - - -
0.9263 1282 5.3661 - - - -
0.9270 1283 5.4411 - - - -
0.9277 1284 4.9452 - - - -
0.9285 1285 5.1046 - - - -
0.9292 1286 5.4537 - - - -
0.9299 1287 5.5682 - - - -
0.9306 1288 5.2226 - - - -
0.9314 1289 5.5745 - - - -
0.9321 1290 5.2679 - - - -
0.9328 1291 5.4995 - - - -
0.9335 1292 5.3984 - - - -
0.9342 1293 5.5281 - - - -
0.9350 1294 5.6193 - - - -
0.9357 1295 5.4300 - - - -
0.9364 1296 5.0684 - - - -
0.9371 1297 5.2344 - - - -
0.9379 1298 5.5178 - - - -
0.9386 1299 5.5361 - - - -
0.9393 1300 4.9324 0.7272 0.4755 0.6541 0.2726

Training Time

  • Training: 5.5 days
  • Evaluation: 1.7 hours
  • Total: 5.5 days

Framework Versions

  • Python: 3.10.19
  • Sentence Transformers: 5.4.1
  • Transformers: 5.5.4
  • PyTorch: 2.11.0+cu130
  • Accelerate: 1.13.0
  • Datasets: 4.8.4
  • Tokenizers: 0.22.2

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

MatryoshkaLoss

@misc{kusupati2024matryoshka,
    title={Matryoshka Representation Learning},
    author={Aditya Kusupati and Gantavya Bhatt and Aniket Rege and Matthew Wallingford and Aditya Sinha and Vivek Ramanujan and William Howard-Snyder and Kaifeng Chen and Sham Kakade and Prateek Jain and Ali Farhadi},
    year={2024},
    eprint={2205.13147},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

CachedMultipleNegativesRankingLoss

@misc{gao2021scaling,
    title={Scaling Deep Contrastive Learning Batch Size under Memory Limited Setup},
    author={Luyu Gao and Yunyi Zhang and Jiawei Han and Jamie Callan},
    year={2021},
    eprint={2101.06983},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}
Downloads last month
64
Safetensors
Model size
2B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for whybe-choi/Qwen3-VL-Embedding-2B-ko-vdr-preview-v0.3

Finetuned
(6)
this model

Papers for whybe-choi/Qwen3-VL-Embedding-2B-ko-vdr-preview-v0.3

Evaluation results

  • Cosine Accuracy@1 on kovidore v2 cybersecurity beir eval
    self-reported
    0.718
  • Cosine Accuracy@3 on kovidore v2 cybersecurity beir eval
    self-reported
    0.899
  • Cosine Accuracy@5 on kovidore v2 cybersecurity beir eval
    self-reported
    0.919
  • Cosine Accuracy@10 on kovidore v2 cybersecurity beir eval
    self-reported
    0.960
  • Cosine Precision@1 on kovidore v2 cybersecurity beir eval
    self-reported
    0.718
  • Cosine Precision@3 on kovidore v2 cybersecurity beir eval
    self-reported
    0.470
  • Cosine Precision@5 on kovidore v2 cybersecurity beir eval
    self-reported
    0.344
  • Cosine Precision@10 on kovidore v2 cybersecurity beir eval
    self-reported
    0.207