Discussions

• 1 You must be logged in to vote

  🙏

  Implicit Q8_1 quantization for matrix multiplications?

  tlemo asked Jul 1, 2025 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Executing neural network using AMX backend

  jkalya asked May 22, 2025 in Q&A · Unanswered

  

  

  7
• 1 You must be logged in to vote

  🙏

  What is the difference between GGML_OP_DUP and GGML_OP_CONT?

  tlemo asked Jun 4, 2025 in Q&A · Answered

  

  

  3
• 1 You must be logged in to vote

  🙏

  Regarding Hardcoded GGML Tensor Name Length Limit (GGML_MAX_NAME)

  Ashot-dor asked May 31, 2025 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  🙏

  Broadcast semantics in GGML?

  tlemo asked May 28, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  GGML_OP_ADD1 vs GGML_OP_ADD?

  tlemo asked May 28, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Can you share (or link) the script used to make the mmproj for Scout Vision?

  justinjja asked May 20, 2025 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Question about weight layout

  pshung asked Mar 20, 2025 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  💬

  Question Regarding Operation offload & Graph Split

  akapoor3518 started Mar 12, 2025 in General

  

  

  2
• 1 You must be logged in to vote

  💬

  Calling ggml_view_3d() on quantised tensors possibly causes alignment problems?

  jukofyork started Mar 11, 2025 in General

  

  

  1
• 1 You must be logged in to vote

  💬

  Need to compile GGML for arm64 using cross compiler

  akapoor3518 started Feb 25, 2025 in General · Closed

  

  

  1
• 1 You must be logged in to vote

  🙏

  A general question on developer beginning point

  mmcheraghi asked Feb 21, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  The lifecycle of ggml tensor

  soccercheng asked Feb 11, 2025 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  💬

  GGML Shape & Strides question

  akapoor3518 started Feb 12, 2025 in General

  

  

  0
• 8 You must be logged in to vote

  📣

  repo : upcoming transfer to ggml-org (ETA: Feb 8-9)

  ggerganov announced Feb 4, 2025 in Announcements · Closed

  

  

  1
• 1 You must be logged in to vote

  💬

  Question about unsupported operation by Backend

  akapoor3518 started Feb 4, 2025 in General

  

  

  1
• 1 You must be logged in to vote

  🙏

  Can we prepend some header(example: memref) on Tensor data which custom hardware can use to execute Tensor Data

  akapoor3518 asked Jan 31, 2025 in Q&A · Closed · Unanswered

  

  

  7
• 1 You must be logged in to vote

  🙏

  Kronecker product of two ggml_tensor: How to?

  stduhpf asked Jan 26, 2025 in Q&A · Answered

  

  

  3
• 1 You must be logged in to vote

  🙏

  What is the best way to support 5d tensor (or even higher dimension)?

  randxie asked Jun 1, 2024 in Q&A · Answered

  

  

  

  

  8
• 1 You must be logged in to vote

  🙏

  Would it be a bad idea to move the static inline functions used in internal asserts to the header file?

  stduhpf asked Jan 20, 2025 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Logits largely different from PyTorch

  lancelotblanchard asked Jan 5, 2025 in Q&A · Unanswered

  

  

  9
• 2 You must be logged in to vote

  🙏

  How does GGML syncing work across ggml / llama.cpp / whisper.cpp repos?

  peter277 asked Jan 11, 2025 in Q&A · Answered

  

  

  3
• 2 You must be logged in to vote

  🙏

  Need help porting PyTorch code to GGML

  tbtlr asked Jan 5, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  How can I get a subset of a ggml tensor?

  mecccaaa asked Dec 26, 2024 in Q&A · Unanswered

  

  

  2
• 2 You must be logged in to vote

  🙏

  How to convert PyTorch model to gguf and how to write gguf?

  tuna2134 asked Dec 30, 2024 in Q&A · Unanswered

  

  

  0